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Abstract. The main purpose of this paper is to compute all irreducible 
spherical functions on G = SU(3) of arbitrary type 5 a K, where 
K = S(U(2) X U(l)) ~ U(2). This is accomplished by associating to 
a spherical function $ on G a matrix valued function H on the complex 
projective plane -P2(C) = G/K. It is well known that there is a fruit- 
ful connection between the hypergeometric function of Euler and Gauss 
and the spherical functions of trivial type associated to a rank one sym- 
metric pair {G,K). But the relation of spherical functions of types of 
dimension bigger than one with classical analysis, has not been worked 
out even in the case of an example of a rank one pair. The entries of H 
are solutions of two systems of ordinary differential equations. There is 
no ready made approach to such a pair of systems, or even to a single 
system of this kind. In our case the situation is very favorable and the 
solution to this pair of systems can be exhibited explicitely in terms of 
a special class of generalized hypergeometric functions p+iFp. 



1. Introduction and statement of results 

The complex projective plane can be realized as the homogeneous space 
G/K, where G = SU(3) and K = S(U(2) x U(l)). We are interested in 
determining, up to equivalence, all irreducible spherical functions, associated 
to the pair (G, K). If {V, vr) is a finite dimensional irreducible representation 
of K in the equivalence class 5 £ K, a spherical function on G of type 5 is 
characterized by 

i) $ : G — > End{V) is analytic. 

ii) ^{kigk2) = TT{ki)^{g)iT{k2), for all ki,k2 e K, g e G, and <I>(e) = /. 

iii) [A2^]{g) = X2^{9), [^3^]ig) = ^3^{g) for all g e G and for some 
A2,A3 G C. 

Here A2 and A3 are two algebraically independent generators of the poly- 
nomial algebra D{G)'^ of all differential operators on G which are invariant 
under left and right multiplication by elements in G. A particular choice of 



these operators is given in Proposition 3.1 
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The set K can be identified with the set Z x Z>o. If A; = [^), with 
A £ U(2) and a = (det^)-\ then 

7r{k) = 7TnAA) = {detAr A\ 

where A^ denotes the ^-symmetric power of A, defines an irreducible repre- 
sentation of K in the class {n,i) E Z x Z>o. 

For n > 0, the representation 7r„ £ of U(2) extends to a unique holomorphic 
multiplicative map of M(2,C) into End(V^), which we shall still denote by 
TTn^e- For any g £ M(3, C), we shall denote by A{g) the left upper 2x2 block 
of g, i.e. 

'511 512' 
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For any it = iTn/ with n > let : G — > End(V^) be defined by 
Then, in Theorem 2.10| we prove that is a spherical function of type (n, I). 



This is the main result of Section These particular spherical functions 
will play a crucial role in the rest of the paper. 

Observe that when n < the function above can be defined on the 
open set 

^ = { 5 € G : det A{g) 7^ } . 

The group G = SU(3) acts in a natural way in the complex projective plane 
P2(C). This action is transitive and K is the isotropy subgroup of the point 
(0,0,1) G P2(C). Therefore P2(C) = G/K. We shall identify the complex 
plane with the affine plane { (x, y, 1) G -P2(C) : (x, y) G }. 

The canonical projection p : G — > -P2(C) maps the open dense subset 
A onto the affine plane C^. Observe that A is stable by left and right 
multiplication by elements in K. 

To determine all spherical functions $ : G — > End(V^) of type vr = iTn/ 
we use the function <I>7r in the following way: in the open set A we define a 
function H by 

Hig) = ^g) <^Agr\ 
where $ is supposed to be a spherical function of type vr. Then H satisfies 
i) H{e) = I. 

W) H{gk) = H{g), for all 5 G ^, A; G K. 
iii) H{kg) = ■K{k)H{g)Ti{k-^), for &\\ g £ A,k £ K. 

Property ii) says that H may be considered as a function on C^. 

The fact that $ is an eigenfunction of A2 and A3, makes H into an eigen- 
function of certain differential operators D and E onC"^ . For completeness 
the explicit computation of these operators is carried out fully in Section ^. 

In Section |5| we take full advantage of the X-orbit structure of -P2(C) 
combined with property iii) of our functions H. The affine plane is K- 
stable and the corresponding line at infinity L is a if-orbit. Moreover the 
K-orbits in are the spheres Sr = { {x,y) G : |xp + |yp = }. Thus 
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we can take the points (r, 0) G Sr and (1,0,0) G L as representatives of Sr 
and L, respectively. Since (M, 0, 1) = (1,0, jj) — > (1,0,0) when M ^ oo, 
the closed interval [0, oo] parametrizes the set of ii'-orbits in P2{C). 

Thus there exist ordinary differential operators D and E on the open 
interval (0, oo) such that 

{DH){r,0) = {DH){r), {EH){r,0) = {EH){r), 

where H{r) = H(r,0), r G (0, oo). These operators D and E are explicitely 
given in Theorems and |5.2| . We need to compute a number of second 
order partial derivatives of the function H : — > End(I4-) at the point 
(r, 0). This detailed computation is broken down in a number of lemmas 
included in the Appendix for the benefit of the reader. 

Theorems |5.l| and |5.2| are given in terms of linear transformations. The 
functions H turn out to be diagonalizable (Proposition ^.10| ). Thus, in 
an appropriate basis of we can write H{r) = {ho{r),--- ,hi{r)). Then 



we give in Corollaries 5.15 and 5.16 the corresponding statements of these 
theorems in terms of the scalar functions hi. 

In Section^ we take into account the behavior of the function H associated 
to a spherical function <I> when r — > oo. The corresponding asymptotic 



behavior of H is given in the first part of Proposition |6.1| . Our strategy to 
obtain all spherical functions of (G, K) will be to find all eigenfunctions H 
of D and E which satisfy this behavior at infinity. This is the point of the 
second part of Proposition [6^] . 

In Section |^ we consider the natural inner product among continuous 
maps from G to End(V^), which makes A2 and A3 symmetric (Proposition 



7.2). In Proposition |7.1| we give the explicit expresion of this inner product 



when restricted to those functions which satisfy $(^1(7^2) = 'JT{ki)^{g)7r{k2) 

We also introduce here the variable t = (l + r^)~^ which converts the 
operators D and E into new operators D and E. Then we present a classical 
analysis motivation for the inner product given in Proposition 

In Section ^ we give a complete description of a method to obtain all C°° 
solutions of DH = XH. This construction rests on some remarkable factor- 
izations of higher order differential operators with Gauss' hypergeometric 
operator as one of the factors. This construction revolves around introduc- 
ing an integer parameter < k < £ as well as a parameter w involved in 
expressing A appropriately. 

The case ^ = is analized in detail and the solutions are given generically 
in terms of 2-^1- For higher i the solutions are obtained by acting on 2E1 
either by differential operators or by appropriate shift operators. 

As we remark in Section ^, there exists a one to one correspondence 
between the set of all equivalence classes of finite dimensional irreducible 
representations of G which contain the representation iTn/ of K, and the set 
of all equivalence classes of irreducible spherical functions of (G, K) of type 
(n, i). This is the starting point we take in Section ^ to get a parametrization 
of all these equivalence classes in terms of all tuples (p, q, k\, /C2) G such 
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that p + q > ki > q > k2 > 0, with n = ki+ 2k2 — p — 2q, i = ki — k2- This 
is the content of Corollary Also in Corollary we give the eigenvalues 
A and ^ which correspond to the differential operators D and E in terms of 
these parameters. Moreover, we introduce here two integer parameters w, k 
subject to the following four inequalities: 0<w,0<k<i,0<w + n-\-k, 
which give a very convenient parametrization of the irreducible spherical 
functions of type {n,£). 

Section 10 starts with Proposition |10.1| where the local behaviour of the 
functions H = H{t) in the variable i = (l+r^)~^ at t = associated to a 
spherical function <I> of type {n,i) is established. In particular it is proved 
that H is analytic and that has a zero of order at least —n—i, when n+i < 0. 
Thus we aim at getting joint solutions to DH = XH and EH = in the 
form of formal power series H{t) = ^j>Qt^ Hj. Since E commutes with D 
we look at the linear map defined by it on the vector space V{\) of all formal 
solutions of DH = XH. This equation gives rise to a three term recursion 
relation for the coefficients Hj. 

When n > 0, one sees that the linear map rj : H{t) ^ H{0) is an isomor- 
phism of V{X) onto C^^^. Using t], E becomes an + 1) x {£ + 1) matrix 
L = L(X). In Corollary 10.4 , r] is used to establish a one to one correspon- 
dence between joint solutions to DH = XH, EH = fiH and the eigenvalues 
fj, of L{X). Moreover there is no joint eigenfunction given by formal power 
series unless the pair (A, /u) lies on the union of {i + 1) straight lines. For 
any point on this curve, if Hq is an eigenvector of L{X) with eigenvalue 
/i, the recursion relation becomes a two term recursion and can be solved 
explicitely in terms of generalized hyper geometric functions. In particular 
they converge for |t| < 1. 

When n < the isomorphism r] must be redefined and the corresponding 
matrix L is not as simple as the one obtained when n > 0. This suggest 
that our choice of the function H associated to a spherical function is most 
appropriate only when n > 0. 

In Section |l^ we illustrate in full detail the results obtained above in the 
cases i = 0, 1, 2 and n an arbitrary integer. The main ingredient here is a 
particular class of generalized hypergeometric functions among those of the 
form p+i-Fp. For each i, we need to deal with several values of p in the range 
1 < p < £ + 1 and thus for i = (and n = 0) we obtain the known result 
involving only 2^1- 

Generalized hypergeometric functions have numerator and denominator 
parameters, as well as an independent variable t. The functions that enter in 
our explicit formulas satisfy the condition that all but two of the numerator 
parameters exceed by one all but one of the denominator parameters. In the 
classical case, with i = 0, there is not enough room for this phenomenon to 
show up. 

We state a fairly explicit conjecture on the dependence of these hyper- 
geometric functions on its main parameters, namely the ones that are not 
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related by the shift described above. These two numerator parameters and 
the denominator one exhaust the ones that appear in the case of 2F1 ■ 

In view of the very important role played by all functions p+i-Fp, p arbi- 
trary, in our description of the entries of the matrix valued spherical func- 
tions, it is worth to note that certain generalized hyper geometric functions, 
more precisely the functions 3n-4F3n-5i have appeared in the expression of 
matrix entries of representations of the group U(n). In this case one can 
consult 1 16] as well as the very systematic treatment in [22|. This very nice 
result extends to the case of arbitrary n the well known results involving 
Gauss' function 2F1 in the case of U(2). It would be nice to see the func- 
tions identified here playing a useful role in other problems in geometry or 
physics. 

In Section 12 we observe that our spherical functions satisfy not only 
a differential equation, but also an appropriate recursion relation in the 
discrete variable w. We display the results in full in the case i = 2 and n 
nonnegative. 

This three term recursion relation is well known in the classical case, when 
i = 0, and it gives the main way to compute in a numerically stable way 
the so called classical orthogonal polynomials. Its importance is not only 
a practical matter. It gives one of the earliest instances of the bispectral 
property. By repeated applications of the Darboux process this innocent 
looking property is tied up with all sorts of other issues of recent interest in 
mathematical physics, including nonlinear integral evolution equations, W- 
algebras, interesting isomonodromy deformations, the whole area of random 
matrix models, etc. There are even q versions of all of this. Moreover this 
is not restricted to the case of one (either spatial or spectral) variable. 

It is natural to wonder about the relation between the matrix valued 
functions constructed in Section 12 and the relatively new theory of matrix 
valued orthogonal polynomials. This issue has been addressed in [Q. It 
suffices to state here that the functions considered in Section 12 do not 
satisfy all the conditions in the theory, see for instance [|[. 

Finally we remark that we have chosen this example as one of the simplest 
to analyze among the symmetric spaces of rank one leading to matrix valued 
spherical functions. We hope to deal with other simple examples in the 
near future. One important case of scalar valued spherical functions of non 
trivial type has been considered in Part I, Chapter 5 of ||l^. The referee 
has wondered what is the perspective for doing analogous things in the case 
of SU(n), and E. Stein had also suggested to consider this more general 
problem. At this point this appears to be a very interesting challenge. 

One can only speculate that many of the connections that make Gauss' 
function a vital part of mathematics at the end of the twenty century will 
be shared by its matrix valued version discussed here. 

It is a pleasure to thank the referee for a very thorough job. In partic- 
ular the referee has redone independently a few of the computer algebra 
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checks that we had originahy done with Maxima by using very nice Maple 
worksheets. 



2. Spherical functions 

Let G be a locahy compact unimodular group and let be a compact 
subgroup of G. Let K denote the set of all equivalence classes of complex 
finite dimensional irreducible representations of K\ for each 5 G iC, let ^5 
denote the character of 5, d{5) the degree of 5, i.e. the dimension of any 
representation in the class (5, and X5 = d{5)(,s- We shall choose once and for 
all the Haar measure dk on K normalized by fj^dk = l. 

We shall denote by y a finite dimensional vector space over the field C of 
complex numbers and by End(y) the space of all linear transformations of 
V into V. Whenever we shall refer to a topology on such vector space we 
shall be talking about the unique Hausdorff linear topology on it. 

By definition a zonal spherical function ( [1lT| ) 99 on G is a continuous 
complex valued function which satisfies (p{e) = 1 and 



(1) (p{x)(f{y) = / (p{xky)dk x,yeG. 

Jk 

A fruitful generalization of the above concept is given in the following 
definition. 

Definition 2.1. ((2^,||]) A spherical function <I) on G of type 6 e K is a. 
continuous function on G with values in End(y) such that 

i) $(e) = /. (/= identity transformation). 

n) ^{x)^{y) = Jj^ xs{k~^)^{xky) dk, for all x,y e G. 



Proposition 2.2. ("[^01,191^ If ^ : G — > End(y) is a spherical function of 
type 5 then: 

i) ^{kgk') = ^{k)^{g)^ik'), for all k,k' £ K, g£ G. 

ii) k I— > <^(A;) is a representation of K such that any irreducible subrepre- 
sentation belongs to 5. 

Concerning the definition let us point out that the spherical function $ 



determines its type univocally (Proposition 2^) and let us say that the 
number of times that 6 occurs in the representation k ^{k) is called the 
height of 

Let (f he a complex valued continuous solution of the equation (|l|). If 



(p is not identically zero then (f{e) = 1. (cf. p. 399). This result 

generalizes in the following way: we shall say that a function $ : G — > 
End(y) is irreducible whenever ^{g), g G G, is an irreducible family of 
linear transformations of V into V. Then we have 



Proposition 2.3. (^[20|j Let <I> be an FiudiV) -valued continuous solution of 
equation ii) in Definition \2.\. If ^ is irreducible then $(e) = I. 
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Spherical functions of type 5 arise in a natural way upon considering 
representations of G. If (7 ^ U{g) is a continuous representation of G , say 
on a complete, locally convex, Hausdorff topological vector space E, then 



P{6) = / X5ik-')Uik)dk 



Ik 

is a continuous projection of E onto P{5)E = E{6); E{6) consists of those 
vectors in E, the linear span of whose X-orbit is finite dimensional and 
splits into irreducible i('-subrepresentations of type 5. Whenever E{5) is 
finite dimensional, the function $ : G — > End(£J((5)) defined by ^{g)a = 
P{6)U{g)a, g £ G,a £ E{6) is a spherical function of type S. In fact, if 
a £ E{6) we have 

^{x)^{y)a = P{5)U{x)P{5)U{y)a= [ X5{k-^)P{5)U{x)U{k)U{y)adk 

Jk 

j ^X5{k~^)^{xky) dk^ a. 

If the representation g ^ U{g) is topologically irreducible (i.e. E admits 
no non-trivial closed G-invariant subspace) then the associated spherical 
function ^ is also irreducible. 

If a spherical function <I> is associated to a Banach representation of G 
then it is quasi-bounded, in the sense that there exists a semi-norm p on G 
and M G R such that 11^(5)11 < Mp{g) for ah g £ G. Conversely, if $ is an 
irreducible quasi-bounded spherical function on G, then it is associated to a 
topologically irreducible Banach representation of G (Godement, see |@). 
Thus if G is compact any irreducible spherical function on G is associated 
to a Banach representation of G, which is finite dimensional by Peter- Weyl 
theorem. 

From now on we shall assume that G is a connected Lie group. Then it 
is not difficult to prove that any spherical function $ : G — > End(y) is 
differentiable (G°°), and moreover that it is analytic. Let D{G) denote the 
algebra of all left invariant differential operators on G and let D{G)^ denote 
the subalgebra of all operators in D{G) which are invariant under all right 
translation by elements in K. 

In the following proposition (V, vr) will be a finite dimensional representa- 
tion of K such that any irreducible subrepresentation belongs to the same 
class 5 £ K. 

Proposition 2.4. (^[p0|,[|9| j A function $ : G — > End(y) is a spherical 
function of type 5 if and only if 

i) $ is analytic. 

ii) ^{kigk2) = TT{ki)^{g)7r{k2), for all ki,k2 £ K, g £ G, and <I>(e) = /. 

iii) [Dmg) = ^g)[D^{e), for all D £ D{G)'' , g£G. 

Let us observe that if $ : G — > End(y) is a spherical function then 
^ : D [D^]{e) maps D{G f into Endi^(y) {EndK{V) denotes the space 
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of all linear maps of V into V which conmutes with Tr{k) for all k £ K) defin- 
ing a finite dimensional representation of the associative algebra D{G)^ . 
Moreover the spherical function is irreducible if and only if the representa- 
tion <I> : D{G)^ — > Endi<-(y) is surjective. As a consequence of this we 
have: 



Proposition 2.5. (^20|,|9|j The following properties are equivalent: 

i) D{G)^ is commutative. 

ii) Every irreducible spherical function of {G, K) is of height one. 

In this paper the pair {G,K) is (SU(3), S(U(2) x U(l))). Then it is 
known that D{G)^ is abelian in this case; moreover D{G)^ is isomorphic 
to D{Gf ® D{K)^ (cf. @, 0), where D{G)^ (resp. D{K)^) denotes 
the subalgebra of all operators in D{G) (resp. D{K)) which are invariant 
under all right tranlations from G (resp. K). Now a famous theorem of 
Harish-Chandra says that D{G)^ (resp. D{K)^) is a polynomial algebra in 
two algebraically independent generators A2 and A3 (resp. Z and Ax). 

The first consequence of this is that all irreducible spherical functions of 
our pair (G, K) are of height one. 

The second consequence is that to find all spherical functions of type 
5 £ K \s equivalent to taking any irreducible representation {V, vr) of K in 
the class 5 and to determine all analytic functions $ : G — > End(y) such 
that 

(1) ^ikigk2) = TT{ki)^{g)TT{k2), for all ki,k2 £ K, g £G. 

(2) [A,$](5) = $(<7)[A,$](e), j = 2,3. 

In fact, because Z and Ak are in D{K)^ and <I> satisfies (1) we have 
[Zmg) = ^g)n{Z) = ^g)[Z<i>]ie) 

and 

[AKmg) = HgM^K) = Hg)[AKme)- 

Here n : tc — > End(K-) denotes the derivative of the representation vr of 
K. We also denote with vr the representation of D{K) in End(l^) induced 
by vr. 

Therefore an analytic function <I> which satisfies (1) and (2) verifies con- 



ditions i), ii) and iii) of Proposition 2.4, and hence it is a spherical function. 



The group G = SU(3) consists of all 3 x 3 unitary matrices of determinant 
one. The subgroup K = S(U(2) x U(l)) consists of all unitary matrices of 
the form 

'A 0^ 



where A G U(2) and a = (det^)"^ 

Clearly the map k A defines a Lie isomorphism of K onto U(2). This 
isomorphism will be used freely in what follows. In particular K will be 
identified with U(2). Let us recall that the identity representation vri of 
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U(2) in C^, as well as the ^-symmetric power of it tt^ : A >—>■ of dimension 
£ + 1 are irreducible. Moreover the representations iTn/ of U(2) defined by 

TTn/iA) = (det A)" A^ neZ,ie Z>o 

is a complete set of representatives of elements in U(2). Thus U(2) can be 
identified with the set Z x Z>o. 

Now let us observe that the representation 7r„ £ extends to a unique holo- 
morphic representation of GL(2, C) and that when n > this extends in 
turn to a unique holomorphic multiplicative map of M(2, C) into End(V^) 
which we shall still denote by 7r„ £. 

For any g G M(3, C), we shall denote by A{g) the left upper 2x2 block 
of g, ie. 

V 521 522. 

Now we are in a position to introduce a particular spherical function on 
G of type (ra, £) for all ra > 0. For any tt = TTn.e with n > we define the 
function • G — ^ End(K-) in the following way: 

Observe that when n < the above formula defines a function on the 
set A = {g & G : det A{g) / 0}. Although in this case is no longer 
spherical it will have a useful role to play. 

To state the following lemma we need some notation. Let Eij denote 
the 3x3 matrix with 1 in the (i,j)-place and elsewhere. We define the 
elements Xp and in the complexified Lie algebra 5[(3, C) of SU(3) by: 
Xf3 = E2,3 and X^ = £^1,3. 

Lemma 2.6. The function has the following properties: 

i) $7r(fc) = 7r{k), for all k £ K. 

ii) ^nihgh) = <^n{ki)'^nig)^7r{k2), for all ki,k2 e K, g e A. 

iii) Xg{<i>A{g) = XA^Aig) = 0, for all geA. 

Proof, i) is obvious and ii) follows directly from the definition of upon 
observing that A{gk) = A{g)A{k) and A{kg) = A{k)A{g) for ah g e G, 
k€K. 

iii) The function extends to a unique holomorphic function 

: SL(3,C) — ^End(y). 
Therefore ioi g e G we have 

Xp ($,) (g) = ^AgcxptXf^) = 0, 

at t=o 

because A{g exptXi^) = A[g) for all t. In a similar way it follows that 

XA^A = 0- □ 
Before proving the next theorem we need some more preparation. 
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Lemma 2.7. Let g G SU(3) and let g(i\j) be the 2x2 matrix obtained from 
g deleting the i-th row and the j-th column. Then 

9ij = (-l)^+^det(g(i|j)). 

The set A = {g £ G : det A{g) 7^ } is an open dense subset of G. 



Observe that by Lemma 2.7, A can also be described as the set of all (7 G G 
such that (733 7^ and that A is stable by left and right multiplication by 
elements in K. 

The group G = SU(3) acts in a natural way in the complex projective 
plane P2{C). This action is transitive and K is the isotropy subgroup of the 
point (0,0,1) G P2(C). Therefore 

P2(C) ~ G/K. 

Moreover the G-action on P2(C) corresponds to the action induced by left 
multiplication on G/K. We shall identify the complex plane with the 
affine plane {(x,y, 1) G -P2(C) : {x,y) G } under the map {x,y) 1— > 
{x,y,l)- 

The projection map p : G — > -P2(C) defined by p{g) = g ■ {0, 0, 1) maps 
the open set A onto the affine plane C^. 

Let us consider on the real linear coordinates (xi, rE2, yi, 1/2) defined 
by: xi{x, y) + i X2{x, y) = x and yi{x, y) + i y2{x, y) = y for all x, y G C^. 
We also introduce the following usual notation: 

d _l f d ■ 9 \ d _l f d . d 
dx 2 \dxi 0x2/ ' dy 2 \dyi dy2 

The next lemma will be proved in Section ^. 

Lemma 2.8. Given H G C°°(C^) denote also by H £ C°°(^) the function 
defined by H{g) = H{p{g)), g G A. Then we have 

/^r T-rx^ ^ 5n OH dH , , g.o OH goo OH 

933 9y 9h dx 5I3 dy 9h dx 



Corollary 2.9. A function H G G°°{jC?) is antiholomorphic if and only if 
{XpH){g) = {X.,H){g) = for all g £ A. 

Proof. The Cauchy Riemann equations say that H is antiholomorphic 
precisely when ^ = ^ = 0. Now the corollary follows from Lemma |2.8| 
upon observing that for g £ A the matrix 

1 ( 9ii -921 



2 

933 \~9l2 922 

is non singular. □ 

Theorem 2.10. For n > and vr = vr„.^, the function is an irreducible 
spherical function of type vr. 
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Proof. We shall prove that <I>,r satisfies the integral equation 



JK 

for all g,a € G. 

We ax g £ G and we consider the function F : A — > End(V^) defined by 

Then we have F{ak) = F{a), for all k £ K. Therefore we may consider F 
as a function defined on the affine plane in P2(C). By Lemma 2.6 iii) 
we have X^^F = X^F = 0. Thus F : — > End(V^) is an antiholomorphic 
function (Corollary |2.9D . 

We fix a G ^ and let p{a) = {x,y, 1). Now, let us consider the function 
f{w) = F{wx,wy), w £ C Then / is a holomorphic function on C with 
values in End(V^). 

Let c(i?) = (" r ' e-°/3 ] £K. Then p{c{^)a) = (e-'^x, e'^'^y, l) 

V e^'^/^J 

and 

f{e''>) = F{e-''x,e-'%) = F{c{^)a). 

We have 

F{c{^)a) = (^j^xn{k-^)^n{gkc{d)a)dk^ ^M^)a)-^ 

Xn{cm-^)'^^{gka) dk] <^>^{ar\{c{'&))-\ 

IK J 

Now we notice that c(i?) is in the center of -fC, thus 7r(c('!9)) is a scalar 
(Schur's lemma) and Xn{c{^)k) = 7r(c(T?))x7r(fc)- Therefore 

fie^^)=Fici^))a)=F{a), 

F(x,y) = /(1) = /(0) = F(0,0), 
for all {x,y) £ C^. Therefore F(a) = F{e) for all a £ A, hence 



Xn{k ^)<Pn{gka) dk \ <^^{a) ^= / x^ik ^)<^^{gk) dk = <^^{g) 

K / J K 

since fj^ XTTik^^)7:{k) dk = I (orthogonality relations). So, we have proved 
that 



$^(5)$^(a) = / Xnik ^)^^{gka) 
JK 



dk, 



for any g £ G and all a £ A. Since A is dense in G and is continuous 
the theorem is proved. □ 

Proposition 2.11. Given any pair {G,K) and a spherical function ^ on G 
of type TT £ k the function <I>* : G — > EndF* defined by ^*{g) = ^{g~^)'^ 
is spherical of type tt* , where vr* denotes the contragradient representation 
o/vr. 
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Proof. The assertion follows directly from Definition |2.1| . □ 

Corollary 2.12. If ^ is a spherical function of the pair (SU(3),U(2)) of 
type {n,£), then $* is spherical of type (— n — £,i). 

Proof. The only thing we have to observe is that vr* ^ is equivalent to 

Therefore to determine all spherical functions of type {n,£) for all n G Z 
it is enough to determine all spherical functions of type {n,£) with n > — |. 
Observe that for n > or n < — £ we have exhibited a particular spherical 
function of type {n,i): precisely or respectively. 

It is useful to keep in mind the symmetry n i-^- — n — £ and the partition 
of the integers in the form 

Z = {n : n > 0} U {n : -£ < n < 0} U {n : n < -£} . 

The spherical functions ^n,e correspond to taking an irreducible represen- 
tation U of G and projecting to the subrepresentation of K generated by a 
highest weight vector of U, precisely when n > 0. Moreover the spherical 
functions ^ correspond to taking an irreducible representation U of G 
and projecting to the subrepresentation of K generated by a lowest weight 
vector of ?7, exactly when n < —£. In Section |l^ this partition of Z will 
appear again. Notice that the exceptional interval {n : —£ < n < 0} ocurrs 
only when i >2. 

To exhibit explicitely a spherical function ^n,i on G of type (n, £) for all 
n < 0, we need to introduce the following notation. If T and S are linear 
operators on a finite dimensional vector space V we shall denote by T^~* • 
the linear map induced hy £ — i factors equal to T and i factors equal to S 
acting on the space of symmetric tensors of rank £. Also for g £ G we let 
a{g) = 933 and 

j^(^g-^ ^ f 913931 9l3932\ 
\ 923931 923932 J 



The proof of the following theorem will be based on Proposition 2.4 and will 



be given at the end of Section ^. This way of proving is needed because the 



function ^n,i does not satisfy a property like the one given in Lemma 
iii) which allows one to establish Theorem 2.10| . 



Theorem 2.13. Forn < 



0<i<mm{-ra,f} 

is an irreducible spherical function of type (n, £) . 



Notice that ^'o/ = ^q/. 
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3. Preliminaries 

The Lie algebra of G is g = {X G 0l(3,C) : X = -X^, tiX = 0}. Its 
complexification is gc = sl(3, C). The Lie algebra t of K can be identified 
with u(2) and its complexification with gl(2,C). 

The following matrices form a basis of q. 



i 
-i 




i 
i 







-2i 



10 
-10 




i 

1 




1 

-10 



i 



1 



Y. 





01 


, >6 = 


0' 





1 


i 





-1 


.0 i 0. 



Let \] be the Cartan subalgebra of gc of all diagonal matrices. The cor- 
responding root space structm'e is given by 



Xa — 


"0 10" 

.0 0. 


, X^a = 


"0 0" 

10 
.0 0. 


, Ha = 


ri 01 

0-10 

Lo oJ 


Xp = 


"0 0" 
1 
.0 0. 


; X^P = 


"0 0" 

.0 10. 


; Hp = 


ro 1 

10 
.0 0-1. 


x^ = 


"0 1" 

.0 0. 


, = 


"0 0" 

.10 0. 


, H^i = 


"10 1 


0-1 



where 



a{xiEii + X2E22 + X3E33) = xi 
(3{xiEii + X2E22 + X3E33) = X2 
7(xi£;ii + X2E22 + X3E33) = xi 



We have 

Xa = ^{Yi-iY2), 

x^a = -UYi+iy2), 

Let Z = Ha + 2Hp, Hi 



Xp = l{Y5-iYe), 
X.p = -^{Y5 + iYe), 

2Ha + Hfs and H2 = Hp 



- X2, 

- X3, 

- X3. 

X.y 
X—j 

- Hry 



-UY3 + iYi). 



Now we shall prove the following lemma stated in Section 2. 

Lemma |2.8| . Given H e C°°(C^) denote also by H E C°°{A) the function 
defined by H{g) = H{p{g)), g G A. Then we have 

9i2 dH dH 



IV u\( \ 3ii dH 521 dH 



533 dy 5I3 dx 



Proof. 2Xp = Y^ 
p{gex.ptY5) -- 



iYq and 2Xj = 13 — iY4. We have 



gi2tant + gi3 522 tan t + 523 
532 tan t + 533 ' 532 tan t + 533 ' 



= {U{t), V{t), 1) = (ni(t) + iU2{t), Vl{t) + iV2{t), 1). 
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If we put iij = (^)^^^ and Vj = (jw) for J = 1, 2, then 



t=o v /t=o 

i=0 



l5(i?)(g) = ( —H{p{gexptY5)) ) = i^ajiiti + H^^U2 + Hy^vi + Hy^V2. 



Also by Lemma |2.7| we have, 

n = -^, ^ = ^. 

^33 ^33 

Similarly, for Yq let 

^(gexptye) = 1) = {ui{t) + iu2{t),vi{t) + W2{t),l). 

Then 

l6(^^')(5) = -ffxi^tl + H^^U2 + Hy^Vl + Hy^V2, 

where _ _ 

^ = -%, ^ = %. 

^33 9'33 

If = ui{t) + iu2{t) then ui = Re(u) and U2 = Im(u). Therefore 
(3) 

= Hx^{ui - iui) + Hx^{u2 - iu2) + Hy^{vi - ivi) + Hy.^{v2 - iv2) 

— -TJ -\--;n -\- n 111 - ^in ill 

— -"xi 2 '' X2 2 yi 2 J/2 2 

533 933 533 533 

ah dx gh dy ' 

We proceed in the same way with {X^H){g) and complete the proof of the 
lemma. □ 



Proposition 3.1. D{G)^ as a polynomial algebra is generated by 
and 



^2 — — — ^•^^ — 2i?Q, — 2Z — AX-.QiX(^ — AX^pX 1^ — AX^-^iX-^i 



A3 = |//^ — + ^H'^Hj3 — ^HaH'^ + 8H^ + AHaHfs + 16Ha + SHf^ 

+ '^X^aXaHa + SX^aXaHfj + 24X^a^a + 12 {X^f^Xf^ + X^^Xj) 

— AX^jjXf^ Hi — AX—jXy H2 + \2X—pX^X—a ~\~ 12X—'yXjjXcf 

Proof. Since G is a connected Lie group, to verify that A2 and A3 are 
in D{G)'^ it is enough to check that they are of weight zero and that 
ad(X„)(Aj) = ad(X^)(Aj) = for j = 2,3. This can be easily accom- 
plished. To prove that 1, A2 and A3 are algebraically independent gener- 
ators of D{G)^ one can use the well known Harish-Chandra isomorphism 
^ : D{G)^ — > S{i))^ where S{i))^ denotes the Weyl group invariants in 
the symmetric algebra of f). (See ||2^, Section 3.2.2). We have 

C(A2) = -H^ - + 4, e(A3) = -lZ^ + HlZ + Z2 + 3//« - 36. 
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If we put Xi = and X2 = then one can verify that S{t)) 

is generated by the algebraically independent elements 1, Xf + X|, and 
Xi{Xf — 3X2). (See Proposition 4 in [^). This completes the proof of the 
proposition. □ 

We write the operators A2 and A3 in the form 

A2 = A2,i^ + A2, A3 = Asji + A3 

where 

A2,K = -Hi - ^Z^ - 2H^ -2Z- AX^aXa € D{Kf, 
A2 = -4(X_^X^ + X^^X^) G D{Gf, 

'^3,K = l-f^a — l-ff^ + ^H^Hp — ^HaHp + SH^ + AHaHp + IQHa + SHfi 

+ 4X_„X„F„ + SX^^X^Hp + 24X_„X„ G I^Ci^)^, 
A3 = 12 + - AX^pXp Hi - AX.^X^ H2 

+ UX^pX^X^a + UX^^XfjXa G D{G)^. 

4. Reduction to P2(C) 

We want to determine all spherical functions <I> : G — > End(l/^) of type 
= T^n/- For this purpose we use the function £ C°^{A) End(K-) 

defined by '^77(5') = TT{A{g)), in the following way: in the open set A we 

define a function H by 

H{g)=^g) '^A9)-\ 
where $ is supposed to be a spherical function of type vr. Then H satisfies 

i) H{e) = I. 

ii) H{gk) = H{g), for allgGA,k£ K. 

iii) H{kg) = ir{k)H{g)TT{k-^), for all g£A,k£ K. 

The projection map p : G — > -P2(C) defined before maps the open set A 
onto the affine plane = { 1) G -P2(C) : {x,y) G }. Thus ii) says 
that H may be considered as a function on C^. 

The fact that $ is an eigenfunction of A2 and A3, makes H into an 
eigenfunction of certain differential operators on C^, to be determined now. 

In the open set ^ C G let us consider the following differential operators. 
For H G C°^(^) End(V;) let 

D{H) = Di{H) + D2{H), E{H) = Ei{H) + E2{H), 

where 

Di{H) = - MX-pXf3 + 

D2iH) = - 4 {Xp{H)X_f,{^^)^-' + X^{H)X_^{<i>^)<i>-') , 
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+12 {X_pX^{H)) $^7r(X_„)$;i + 12 (X.^XpiH)) <^^7r 

E2{H) = - 4Xp{H)X_p{^^) f{Hi)^-^ - 4X^(iJ)X_^($^) 77(^2)$^^ 

+ l2X^{H)X_p{^^)'k{X_^)^-^ + 12X^(/f)X_^($07r(X„)$-i. 

Proposition 4.1. For H G C°°(^) (X" End(y7r) right invariant under K, 
the Junction $ = H^^t^ is an eigenfunction of A2 and A3 on A if and only 
if H is an eigenfunction of D and E. Moreover, if X, jl, A and fi denote 
respectively the corresponding eigenvalues 0/ A2, A3, D and E then 

A = A - 7r(A2,ft:), /x = /x + 3A - 7r(A3,/f). 

Proof If X G e then X{H) = 0. So, {XY){H^^) = H{XY){^^), for 
all X,Y £ t More generally A{H^^) = H A{^^) = H^^-kiA), for all 
A G D{K). 

Since = X^($7r) = we obtain 

{X_pXp + X_.,X.,){H<i>^) 

= (X^pXp + X_^X^){H)^^ + + X^{H)X^^{^^). 

In this way 

(4) A2(i^$.) = (A2,i^) + D{H)^^. 

Similarly for A3 we have 

(5) 

A3(i?$,) ={H^n)^ (As^k) -4{X_pXp{H^,)) 7r(#i) 

-4{X-^X^{H^^)) 7r{H2) + 12{X_pX^{H^^)) 7r(X_a) 

+ 12 (X_^X;3(^^$7r)) HXa) + 12 + X-^X^) (H^^) 

=(i7$^)7r (A3,if ) + E{H)^^ - SD{H)^^. 

By Schur's lemma tt (A2,r') and tt (A^^k) are scalar because A2,/i' and 
A3,K e D{K)^. Now it is clear that A2{H^^) = \{H^^) and AsiH^^) = 
jl{H^^) if and only if D{H) = XH and E{H) = with 

A = A — TT (A2,k) and fi = jl — -k (A^^k) + 3A. 

□ 

Given H G C°°{C^) ® End(F7r) we shall also denote by G C°^{A) ® 
End(K-) the function defined by H{g) = H{p{g)), g E A. Moreover, if F is 
a linear endomorphism of C°^{A) (X" End(V^) which preserves the subspace 
C~(^)^ End(K) of all functions which are right invariant by elements in 
K, then we shall also denote by F the endomorphism of C°°(C^) ® End(V^) 
which satisfies F{H){p{g)) = F{H){g), g e A, H e C°°(C2) ® End(F^). 
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Lemma 4.2. The differential operators Dj and Ej (j = 1,2) introduced 
above, define differential operators Dj and Ej acting on C°^(C^) (X'End(V^). 

Proof. The only thing we really need to proving is that Dj and Ej (j = 1, 2) 
preserve the subspace C°^{A)^ (g> End(K)- 

It is easy to see that Di = -A{X_pXp + X-^X^) £ D{G)^ . Then Di 
preserves C°^{A)^ End(K-). From (|) we get 

D{H) = /\2{H^n)^-^ - n{A2,K)H. 

Since A2{H<^^)<^~^ £ C°°(^)^ End(K) it follows that D and therefore 
D2 preserve C°°{A)^ (g) End(T4). 

Let us now check that E2 has the same property. Since K is connected this 
is equivalent to verifying that for any X £ t and all H £ C°°(^)-^(8)End(y,r) 
we have XE2{H) = 0, which in turns amounts to prove that 

- XXp{H)X^p{^^)ii{Hi) - Xp{H)XX_p{^^)ii{Hi) 

+ Xp{H)X^p{^^)ii{Hi)ii{X) - XX^{H)X^^{^^)ii{H2) 

- X^{H)XX^^{^^)-k{H2) + X^{H)X^^{^^)i:{H2)-k{X) 

+ ^XX^{H)X^p{^^)ii{X^^) + 3X^{H)XX^p{<^MX-a) 

- 3X^(i/)X_^($^)^(X_,)^(X) + 3XXpiH)X_^{<i>MXa) 

+ 3Xp{H)XX_^i'^^)iriX^) - 3Xp{H)X^^{<^^)7riXMX) = 0. 

Because X{H) = and X(^-,^) = <I>^7r(X), this is also equivalent to 
showing that 

- [X,Xp]{H)X^p{<^^)^Hi) - Xp{H)[X,X^f,]{^^)n{Hi) 
+ Xp{H)X^p{<^^)'fr{[HuX]) - [X,X^](if)X_^($^)^(^2) 

- X^iH)[X,X-^]i<^^)ir{H2) + X^{H)X^^i<^^)iri[H2,X]) 

+ 3[X,X^]{H)X^p{^^)n{X-a) + 3X^iH)[X,X^fs]{^^)niX^^) 
-3X^{H)X^pi<^^)iri[X.a,X])+3[X,Xp]iH)X-^i<^>^)ir{Xa) 
+ 3XpiH)[X,X-^]i<^^)n{Xo,)-3XpiH)X-^i<^>^)iri[Xa,X])=0. 

If we put X = T G in (D and use 7(r) = a{T) + p{T) we get 

- f3{T)Xp{H)X^p{<^^)'fr{Hi) + p{T)Xp{H)X^f3{<^^)'k{Hi) 

- 7(r)X^(if)X_^($^)^(^2) + j{T)X-y{H)X^^{<^^)'fr{H2) 

+ 37(T)X^(i?)X_^($^)^(X_„) - 3f3{T)X^{H)X^fsi<i>MX~a) 

- 3a{T)X^iH)X_^{<^>MX-a) + 3/3(r)X^(i7)X_^($^)7^(X„) 

- 37(T)X^(F)X_^($,)7^(X„) + 3a(T)X^(F)X_^($^)7T(X„) = 

If we substitute X = Xa in (^) and use [Xq, = Xy, [Xa,X^y] = —X^p, 
[Xa,X_a] = Ha, [Xa, X^] = [Xq,,^./?] = 0, we obtain 

- X-,{H)X_p{^^)ir{H^) + a{Hi)Xp{H)X_pi^MXa) 
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+ ^X^{H)X_p{^MHa) + 3X^{H)X_^{^MXa) 
-3XpiH)X^p{<^>MXa) = 

because 3Ha + H2 — Hi = 0, a{Hi) = 3 and a{H2) = —3. Now the 
representation theory of GL(2,C) tell us that XE2{H) = for all X el. 
From @ we get 

E{H) = ^^{H^^)^-^ - (^(A3,i^) - 3D){H). 

Since A3(iJ$^)^>-i e C°°{A)^ ® End(V;) it follows that E and therefore 
El preserve C'^{A)^ ® End(V^). This finishes the proof of the lemma. □ 

For gf G ^ we put p{g) = (x, y, 1). Then 
(7) a; = 5i3533S y = 923933 ^ Is-ssT^ = 1 + + 



The proofs of Propositions L3, iA, |4.5| and |4.6| require simple but lengthy 



computations. We include them for completeness in an Appendix at the end 
of the paper. 

Proposition 4.3. For H G C°°(C2) ® End(T4) we have 
Di{H){x,y) = 

(1 + + ( (H,^^, + H,,,,){1 + + {Hy,y, + Hy,y,){l + \y\^) 
+ 2{Hy^x^ + Hy^xi) Re{xy) + 2{Hy^x2 - Hy^xi) Im(xy)) . 

Proposition 4.4. For H G C°°(C^) ® End(T4) we have 
D2{H){x,y) = 

dH + x^y\ /y\x\^ x{l + \y\^y 



Proposition 4.5. For H G C°°(C^) ® End(T4) we have 
Ei{H){x,y) = 



(l + N^ + lyp) {Hx,x,+Hx2X2)H + N 



2^ 



2(l + |yp) 
3xy + 
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UH )ir( '^^y-^y -3(1 + M') 

+{Hy,,, + Uy,,,) TT ^ 2xy - xy 

Proposition 4.6. For H G C°°(C2) End(F^) we have 
E2{H)ix,y) = 

dHf.fQx\.f -2xy 0\ . / x 0\ . / 1 + \x\^ 3xy 

, A /O .r\ /-2(1 + \y\^) V - 0\ /yx 3(1 + \y\^)\\ 
^%V[oy)\ 3yx 1 + \y\^ ) ^ \y ) -2yx )) ' 

5. Reduction to one variable 

We are interested in considering the differential operators D and E applied 
to a function H G C°°{C'^) (g) End(y^) such that H{kp) = Ti{k)H{p)Ti{k)-^ , 
for all A; G ii' and p in the affine complex plane C^. This property of H 
allows us to find ordinary differential operators D and E defined on the 
interval (0, co) such that 

{D H) (r, 0) = {DH) (r ) , {EH) (r, 0) = {EH) (r ) , 

where H{r) = H{r,0). We also define differential operators Di, D2, Ei 
and E2 in the same way, that is {DiH){r,0) = {DiH){r), {D2H){r,0) = 
{D2H){r), {EiH){r,0) = {EiH){r), {E2H){r,0) = {E2H){r). 

The goal of this section is to prove the following theorems. 

Theorem 5.1. We have 



2,2^^ . (1 + ^ ) . 9 ^9..„-.\dH 



D{H){r) = (1 + n'-r^ + ^ 3 + - 2r^Tr{H^, , ^ 

ar^ r \ ar 



^(l + r^) 



(7r( J)2 H{r) + H{r)7r{J)^ - 2i:{J)H{r)'k{J)^ 

(1 + ^^) (j,(T)'^H{r) + H{r)n{T)^ -2n{T)H{r)7:{T) 



47r{X_a)H{r)n{X^) + 4H{r)7r{X_a)HXa), 



where ^ — ^ q ) ~ ( 1 
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Theorem 5.2. We have 



E{H){t) 

^,nd^H ,~ il + r'^f dH ,~ 2(1 + r'^)dH ~ 

= 1 + 2 -— 7^0f^2 + ^ ^ -r + ^ ^CH^i 

ar^ r ar r dr 

+ 2r(l + r2) — (^3 7^(X„)7^(X_,) - ir{H^)n{H2) 



r \ dr dr 



+ (1±!:!) ( ^( j)2 ^(^) + ^(^) ^( j)2 _ 27r{J)H{r) n{J) ) 7^(/7i) 



2\ 

'7^(r)2 H{r) + i7(r) 7^(r)2 - 2ir{T)H{r) ^{T) ) ^{Hi] 
+ 4 il{r) - H{r) + 3 ii{H^)ii{XoS) 



The proof of these theorems will be a direct consequence of Propositions 
5.11 , ^.12 , 5.13 and 5.14 . To reach this goal we need some preparatory 



material. 

Since we are interested in considering functions H on P2(C) such that 
H{kp) = 7r{k)H{p)7r{k)~^ , for all A; G K and p £ P2{'C) we need to see 
the /C-orbit structure of P2{C). The affine plane is ii'-stable and the 
corresponding line at infinity L = {{x,y,0) : G C^} in P2(C) is a K- 
orbit. Moreover the ii'-orbits in the affine plane correspond to the spheres 



Sr = { {x,y) G : \xf + = } , r G R>o 



in C^. In each affine orbit we may choose as a representative the point 
(r, 0) G C^, with r > 0. In fact given {x,y) G C^, there exists k G K such 
that k (r, 0) = (x, y) where = |xp + Also we may choose (1, 0, 0) as a 
representative of the line at infinity. Since (M, 0, 1) = (1,0, jj) — > (1,0,0) 
when M ^ oo, the closed interval [0, oo] parametrizes the set of ii'-orbits in 
P2(C). This orbit structure is depicted in the figure below. 
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(0,0,1) 

K-orbits in P2(C) 



Turning to the proofs of Propositions [5 . 1 1| , ^.12| , 5.13 and 5.14 and refering 
to Propositions 4.3, 4.4, 4.5 and 4.6 we need to compute a number of first and 
second order partial derivatives of the function H at the point (r, 0) E C^. 
These are given in Lemmas 5.3 through 5.9 whose proofs are included in the 
Appendix. 

Lemma 5.3. At (r, 0) G we have 

dH cP H 

H^^{r,0) = —{r) and H^^^^{r,0) = -^{r). 



Lemma 5.4. At (r, 0) G we have 



HyAr, 0) = -- (^(J)^(r) - ^(r)^(J) 



and 



Hy^y. ir,0) = l^ + ^ H{r) + H{r) 

where J = (^^q^. 

Lemma 5.5. At (r, 0) € we have 

Hy,ir,0)='-(7riT)Hir)-H{r)niT) 

and 



MJ)Hir)niJ), 



r dr 



where T 



'01\ 

,10/- 



Lemma 5.6. At (r, 0) G we have 



H,Ar,0) = - [ii{H^)H{r)-H{r)ii{H^ 
r * 
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and 

^x...(r,0) = - ^ {i:{H^fH{r) + H{T)i,{H^f) 

+ ^T,{H^)H{r)i,{H^). 

Lemma 5.7. At (r, 0) G we have 



Lemma 5.8. At (r, 0) G we have 

Hy,x, (r, 0) = - ^ (^(^a) KJ) + KJ) ^{H,S) H{r) 



^H{r) (niHa) 7r(J) + 7r(J) n{Ha)) 

7r{H^) H{r) 7r( J) + 7r( J) ^(r) 7r(i7a)) . 



I 

-•2 



Lemma 5.9. j4t (r, 0) G C we have 



+ 

r 



Proposition 5.10. The function H is diagonalizable. 
Proof. Let M = { nia : |a| = 1 } where 

The subgroup M fixes the points (x, 0, 1) in the projective plane. More- 
over H{kg) = 7r{k)H{g)7r{k~^), therefore H{r) = 7r(ma)H {r)7r(m^^) . Now 
since all finite dimensional irreducible i^-modules are multiplicity free as 
M-modules, H{r), r >0, and 'k{Ha) diagonalize simultaneously. □ 

Proposition 5.11. We have 

D,{H){t) = (1 + r^f^ + (1 + r2)(3 + r^) 

ar^ r ar 



^(l + r2) 



(TT{jf H{r) + H{r)7r{jf - 27r( J)#(r)7r( J)) 
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^^-^ (^(r)2 H{r) + H{r)ir{Tf - 2n{T)H{r)ir{T)'^ . 



Proof. By Proposition 4.3 we have 



Using the lemmas above and the fact that H{r) and 7r{Ha) commute because 
they are simultaneously diagonalizable, the proposition follows. □ 



Proposition 5.12. We have 

dH 

dr 

Aii{X-^)H{r)iT{X^) + 4i7(r)^(X_„)^(X«). 



D2{H){r) = -2r(l + r'^)'^ n{H^, 

dr 



Proof. By Proposition 4.4 we have 



D2iH)ir, 0) = -4 0) ^ ^) + f «) - o)) 

Now using the lemmas above we compute ^{i",0) and ^(r, 0). 



(8) 



dx V ' / dy 

dH IdH idH 

IdH 1 , , 1 fr, ^ -/rr N ^ dH 



(9) 
dH 
dy 



, IdH , , idH , , 
2 ayi 2 dy2 

= -^HJ) H{r) + l#(r) ^( J) + l^(r) ^(r) 
= -n{X^a)H{r) - -H{r)ir{X.a). 



1 

2^ 



Hir)niT) 



The proposition follows. 



□ 
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Proposition 5.13. 

EiiH)ir) 



+ 5(i±i!)!(.(x.)fi-^*(x„))*(x_„) 

r \ dr ar / 



r V dr dr 

+ ( 7t( J)^ /7(r) + i/(r) ii{JY - 2MJ)H{r) n{J) ) n{Hi) 

^^^''^^ I iT{Tf H{r) + H{r)i:{Tf - 2iT{T)H{r)iT{T)] ir{Hi). 



Proof. By Proposition [4.5| we have 

Ei{H){r,0) ={1 + r^f(H^,,,{r,0) + H^,,,{r,0)) ii{H2) 



+ (1 + r2) ( Hy,y, (r, 0) + Hy,y, (r, 0) ) ^(^i) 



1 

r2 



- 3(1 + r^) (Hy,^, (r, 0) + i/,,,., (r, 0)) ^ ( . 
+ 3i(l + r^) (i/,^,^ (r, 0) - H,,y, (r, 0)) ^ ( ^ 



Since, as noticed before, H(r) and ■k{Ha) commute, from Lemmas 5.8 and 



5.9 we get 



Hy,., (r, 0) =^ [j^iT) n{H^) - n{H^) n{T)) H{r) 
^ H{rW) - \n{J)H{r). 



In this way we obtain 

Ei{H)[r) 



ar^ r dr r dr 
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3(l + r2)/ di? dH 



+ ii±!:!l ( J)2 H{r) + iJ(r) J)2 - 2n{J)H{r) n{J) ) ^(iJi) 



- (7^(T)2 iJ(r) + ^(r) ^(r)2 - 2n{T)H{r) 7^(r)) 7t(^i). 

We observe that combining lines (^) and (^TJ) one gets 

r dr r dr 

By using that 7r(T + J) = 27T(Xa) and 7T(r — J) = 27T(X^a) the proposition 
follows. □ 



Proposition 5.14. 



E2{H){r) = 2r{l + r') — [?,iT{XM.X-a) - iriH^MH^) 

+ 4 H{r) - H{r) + 3 7^(F^)^(X,) ) . 

Proof. By Proposition [4.6| we have 
E2{H){r,Q) = 

5x ^ ' \ VOOy' V3(l + r2)0y' ^ Vooy V -2(l + r2) 



By d) and (|) we have 

oH , . 1 dH uH , , 1/, , , x\ 

^(r,0) = -— , — (r,0) = -(^(X_„)/7(r) - F(r)^(X_„)). 

Now the proposition follows easily. □ 

The Theorems and ^.21 are given in terms of linear transformations. 
Now we will give the corresponding statements in terms of matrices by 
choosing an appropriate basis. 

If vr = 7r„^£ it is well known (see |15], p. 32) that there exists a basis {vi\ 
of such that 

'k{Ha)vi = {i- 2i)vi, 

7:{Xa)vi = {i - i + l)vi_i, (u_i = 0), 
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7r(X_a)vj = {i + l)vi+i, {ve+i = 0). 



Since we are dealing with a representation of U(2) these relations have to 
be supplemented with 

7r{Z)vi = {2n + e)vi. 

This follows from 

We introduce the functions hi{r) by means of the relations 

H{r)vi = hi{r)vi. 

Corollary 5.15. The function H(r) = {ho{r), ■ ■ ■ ,h^{r)), (r > 0), satisfies 

{DH){r) = \H[r) if and only if 

(1 + r^fh'l + ii±^ (3 + r2 - 2r^{n + l-i))h'^- 4i{i - i + - hi) 

+ ^^^((^ + m- i){hi+i - hi) +i{£-i + - hi)) = Xhi 

for all i = 0, ■ ■ ■ 

Proof We have J = - X^^, T = Xa + X^^ and = + \Ho,. Then 
TT{jfH{r)vi = {l-i + l){l-i^ 2)hiVi-2 

-{{e-i + l)i + + !){£ - i)) hiVi + + l){i + 2)hiVi+2, 

H{r)7r{J)^v, = {i- i + l){l- i + 2)hi_2Vi-2 

-{{£-i + l)i + {i + !){£ - i))hiVi + + l){i + 2)hi+2Vi+2, 
TT{J)H{r)'k{J)vi = {l~i + l){e - i + 2)hi-iVi-2 + {i + + 2)hi+iVi+2 
-{{e-i + l)ihi-i + ii + !){£- i)hi+i) Vi, 
7r{T)^H{r)vi = {£ - i + l){i - i + 2)hiVi-2 

+ {{£-i + l)i + {i + l){i - i)) hiVi + {i + l){i + 2)hiVi+2, 
H{r)7r(T)\i = {£ - i + l)(i - i + 2)hi.2Vi-2 

+ {{i-i + l)i + ii + !){£- i))hiVi + {i + l){i + 2)hi+2Vi+2, 
7r{T)H{r)7r{T)vi = {i - i + 1)(£ - i + 2)h,^iVi^2 + {i + l)(i + 2)hi+iVi+2 
+ {{£-i + l)ihi-i + {i + !){£- i)hi+i) Vi, 

■fr{X-a)H{r)Tr{Xa)vi = i{£-i + l)hi-iVi, 
H{r)n{X_a)MXa)vi = i{£ - i + l)hiVi. 
Therefore, 

[DH) {r)vi = ((1 + r^hiir) + ^^r^ (3 + - 2r^in + £ - i)) h',{r) 
+ ^^{{i + m- i)hi+i{r) +i{£-i + l)hi^i{r) 
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- - i + I) + (i + - i)) hi{r)) 

-4i{i-i + l)ih^.i{r)-h,{r))y,. 
The proof is finished. 
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□ 



Corollary 5.16. The function H(r) = (/io(r), • • • , hi{r)), (r > 0), satisfies 
{EH){r) = iJ,H{r) if and only if 



in-e + 3i){l + r^h'l + 6(i + - i) 



6i{£ -i + l) 



h'i^^ + {n-e + 3i) 



K+1 

(3 + r2 -2r2(n + £-i)) h'^ 

+ 4(n + 2e- 3i)^ii^((i + !)(£- i)ihi+i - hi) +i{i-i + - hi)) 

+ Ai{l -i + l){2n + i + 3)(/ii_i - hi) = fihi 
for all i = 0, ■ ■ ■ ,i. 

Proof We have H2 = - ^Ha, Hi = \Z + = \Z + ^H^. By 

using the computations in the proof of Corollary ^.15 we obtain: 

\n-e + 3i){l+rYh1 



{EH){r)v, 

+ (n - ^ + 3i)^^±^h[ + 2(n + 21- 3i)^h'i 

+ 2r(l + r'^)hi{3{i + !){£- i) - {n + i - i){n - i + 3i)) 



+ 6 



{i + !)(£- i) (K^, - - 6(i±^ + l){hU - h[) 



+ 4(n + 2£ - 3i)^iif^(i + l){l - i){hi+i - h,) 
+ 4(n + 2£ - 3i)^i±^^i(^ - i + - /li) 

+ Ai{l - i + l){2n + I + 3){hi^i - hi)^Vi. 



□ 



Corollary 5.17. //F(r) = (/io(r), • • • , /i£(r)), (r > 0), satisfies {DH){r) = 
\H{r) and extends to a C°° function on r > 0, then /io(0) = • • • = /i£(0). 

Proof. From Corollary 5.15| , by multiplying by r"^ and evaluating at r = 0, 

we get 

{i + l){i - i){hi+i{0) - hi{0)) +i{£-i + l)(/i^_i(0) - h,{0)) = 

for i = 0,1, . . . ,£. Now the assertion follows by induction starting at i = 
and ending at i = i — 1. □ 



We take the opportunity to sketch a proof of Theorem |2.13| based on 



Corollaries 5.15 and 5.16 



Theorem |2.13| . For n < 

0<i<min{— n/} 



-n 



a{g)-^~'A{gf-^.B{gy 
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is an irreducible spherical function of type {n,i). 
Proof. Let vr = 7r„ ^ and let 



la- 



1 



gir) 



(l+r2)i/2 



. zj: 

\(l+r2)i/2 





1 





(l+r2)l/2 



1 

(l+r2)i/2^ 



By Propositions p.4| and 4.1 it is enough to check that the function H{r) = 
^„ £(5'(r))$^((7(r))~^ is an eigenfunction of the differential operators D and 



E given respectively in Theorems 5.1 and 5.2. 

Let {61,62} be the canonical basis of C"^ and let Vi = e^~^e\ be the cor- 
responding basis of the space of symmetric tensors of rank i. Then we can 
look at the coordinate functions (/iq, • • • of H associated to the basis 
{vi}. Then it is not difficult to check that 



hi{r) = (1 + r 



2\n 



E ( 

0<j <min{— n,£—i} 



-ly 



-n 



J 



J 



„2i 



, hp 



IS a si- 



Now it is straightforward but lengthy to verify that {ho, 
multaneous solution of the systems given in Corollaries 5.15| and p. 16 with 
X = An{£ + 2) and n = An{£ + 2){n- £). □ 

6. Extension to G 

Let us recall where we are: if <I> is a spherical function on G of type 
71" = T^n/ we have associated to it a function H{r), r > with values in 
End(T4-) which is an eigenfunction of the differential operators D and E 
(Theorems 5.1 and 5.2). Now we want to characterize the behavior of H 
when r 00. 

The complement A"^ of ^ in G is defined by the condition (733 = 0. This 
set is clearly left and right invariant under K. 
For any t e M let 

cos t sin t ^ 
a{t) = I 10 

sin t cos t / 



Then for ah -7r/2 < t < 7r/2, a{t) G A and 



a(7r/2) 



lim a{t) 



1 
10 
-10 



G A". 



Now if 5 G A'^, p{g) = (513,523,0) G L. Since the line at infinity L is 
a i^-orbit, there exists k £ K such that p{g) = kp{a{-K /2)) = p{ka{-K/2)). 
Therefore g = ka{Tr/2)k' for some k' G K. Thus A" = Ka{-n/2)K. 

On A we have written <I> = H^-,^. Hence if we put A{t) = A{a{t))., for 
— 7r/2 < t < 7r/2 we have 

$(a(t)) = (cost)'' H{a{t))A{t)^ = (cost)" (tan t)^(t)^ 
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since p(a(t)) = (tant,0, 1). 

If we make the change of variable r = tant and let t — > 7r/2 we obtain 



$(a(7r/2)) = lim{l+r^y^H{r 




where the exponent i denotes the ^-th symmetric power of the matrix. If we 
use the basis {vi} of introduced before we have proved the existence 
of 

„ (n + i-i) 

lim (1 + r^) 2 hi{r) = Li 

r^oo 

for i = 0. • • • ,£. This follows directly from ■k{H^)vi = (n + £ — i)vi and 



exp tH^ - 

Given x G C with Ixl = 1 let us consider the element 



b{x) =01 G i^. 




Then 6(x)a(7r/2) = a(7r/2)6(x"i). Now 

$ (6(a:)a(f )) Vi = 7r(6(x))$(a(f = x^+^-^L^t;,, 

$(a(f )6(x-i))t;i = $(a(f ))7r(6(x-i))z;i = LiX-("+^-^)t;,. 

Therefore if i 7^ n + then Lj = 0. Thus we have proved the direct part of 
the following proposition. 

Proposition 6.1. If ^ is a spherical function on G of type vr = iTn,i and 
H = (/iQ, • • • , hi) is the associated function, then 

[) H = H{r) is a -function for < r < 00 and H(0) = (1, • • • ,1). 

ii) Ifi^n + e, lim (1 + r2)-("+^-*)/2/ii(r) = 0. 

r— »oo 

If i = n + i, lim hi{r) = Li exists. 

r— »oo 

Conversely if H is an eigenfunction of D which satisfies conditions i) 
and ii), then there exists a unique C°° -eigenfunction ^ on G of A2 which 
satisfies condition ii) of Proposition 2^ to which H is associated. Moreover 
if H is also an eigenfunction of E then <^ is spherical of type {n,i). 

This proposition will play a crucial role in Section [l^. We will already 
come back to it in Section p^ . 

Proof. As we said before the second part is the only one which needs to 
be proved. First we want to extend H to the whole affine plane C^, in such 
a way that the extended function H satisfies H{kq) = 7:{k)H{q)TT{k~^) for 
all k £ K and all q G C^. We observe that for q = (x, y) G - {(0, 0)} the 
element 



k{q) = k{x,y) = {\xf + 



( x-y 
y X 
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1 



lies in K and q = k{q){r, 0) where r = + ^ . Let 
H{q)=7r{k{q))Hir)7r{k{qr'). 

Then H is a C°° function on - {(0, 0)}. Now we shah see that H extends 
to a continuous function on C^. In fact we can equip with a scalar product 
such that 7r(/e) becomes a unitary operator for all k G K. If we denote with 
II II the corresponding operator norm on End(V^) the we have 

\\Hiq) - I\\ = \\7r{k{q))iH{r) - I)7r{kiq)-')\\ = ||^(r) - I||, 

and our assertion follows. 

Let us check now that H{uq) = TT(u)H{q)TT{u^^) for all u £ K,q £ C^. We 
may assume that q = {x,y) 7^ (0,0). Then k{uq){r,0) = uq = uk{q){r,0). 
Therefore there exists m £ M such that k{uq) = uk{q)m. Thus 

H{uq) = TT{k{uq))H{r)TT{k{uq)-^) 

= 7r{u)TT{k{q))'K{m)H{r)TT{'m^^)TT{k{q)~^)'K{u~^) 
= 7r{u)H{q)7r{u-'), 



since 7r(m) and H(r) commute (Proposition 5.10| ). 



Now we lift the function H to a continuous function H = H op on A with 
values in End(T4-) which is C°° on A — K. Then the function <I> = H^t^ is 
a continuous function on A which is a C°° eigenfunction of A2 on ^ — i^T, 
satisfies <I>(e) = I and ^{kigk2) = 7T{ki)^{g)7T{k2) for ki,k2 e K, g e A. 
We shall next show that <I> can be extended to a continuous function on 



G with property ii) of Proposition 2.4 . 
As V 

we put 



As was pointed out before A'^ = Ka{'K /2)K and a(7r/2) = lim a[t). So 



$(/!:ia(7r/2)A;2) = 7r(A;i) lim {costY H {tan t)A{ty'K{k2). 

t — ^7r/2 

First of all we see that by hypothesis L = lmii_,^i2{cost)^H{tant)A{tY 
exists. But we still need to verify that if k\a{'K /2)k2 = /iia(7r/2)/i2 then 
7r{ki)L7r{k2) = 7r(/ii)L7r(/i2), to have a good definition of This is equiv- 
alent to proving that if ka{'K/2) = a{Ti/2)h with k,h £ K then Ti{k)L = 
LiT{h). It is easy to see that ka{'K/2) = a(7r/2)/i happens if and only if 
k = h{x)m and h = h{x~^)m, for some x G C, |a;| = 1, and some m G M. 
Then 

Tr{k)L = 7r{b{x))7r{m)L = TT{b{x))LTT{m) = LTr(b{x^^))7r{m) = LTr{h), 

because the hypothesis ii) of the proposition says precisely that 7r(6(x))L = 
L7r(6(x-i)). 

So we have a continuous function ^ on G with values in End(l^) which 



satisfies condition ii) of Proposition 2.4 and which is a C°°-eigenfunction of 



A2 on the open set A — K. Since the complement of this set A'^ U K is of 
Haar measure zero in G and A2 is an elliptic differential operator we conclude 
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(Weyl's theorem, see for instance [14|, p. 96) that $ is a C°^-eigenfunction 
of A2. The proposition is proved. □ 

7. The inner product 

Given a finite dimensional irreducible representation vr = 7r„^£ of K in the 
vector space let (C(G) End(y,r))^^^ be the space of all continuous 
functions <I> : G — > End(K-) such that ^{kigk2) = TT{ki)^{g)7r{k2) for all 
g G G, ki,k2 € K. Let us equip K- with an inner product such that 7r{k) 
becomes unitary for all k £ K. Then we introduce an inner product in the 
vector space (C(G) 03 EndlV-,^))^^^ by defininig 



(cD,^/) = / tr($(<7)^(ffr)d5: 
Jg 



where dg denote the Haar measure on G normalized hy j^dg = 1, and where 
^'(g)* denotes the adjoint of ^'(g) with respect to the inner product in V-^. 

Let us write $ = H^^^, ^ = -F^tt on the open set ^ of G and put 
H{r) = {hi{r), • • • , hi{r)), F{r) = • • • , fe{r)) as we did in Section ^. 

Proposition 7.1. //^>,^' G (C(G) End(K))^''^ then 



poo 

($,*) = 4V / r3(l + r2)-("+^+3-*)/i.(r)/i(r)dr. 

Proof. Let us consider the element H = Ei^—E^i G g. Then H is conjugate 
by an element of G to i{Ha + Hp), thus ad H has and ±1 as eigenvalues 
with multiplicity 2 and ib2i as eigenvalues with multiplicity 1. 

Let A = exp M.H be the Lie subgroup of G of all elements of the form 

(cost sin A 
1 , t£R. 
— sin t cos t J 

Then the function D : A — > M defined by 

D{a{t)) = Ylsmiti^{H), 

V 

where the product runs over the eigenvalues 1/ = i,2i of ad H counted with 
multiplicities, becomes D{a{t)) = — sin^tsin2t. 



Now Corollary 5.12, p. 191 in |12] establishes that 

figK) dgK = 2 [ ( T^' |Z)(a(t))|/(A;a(t)i^) dt) dku , 

G/K J K/M ^ Jo ' 

where dgK and dku are repectively the invariant measures on GjK and 
KjM normalized by ^Qj^^dgK = Jk/m'^^^ = ^■ 

Since the function g 1— > tT{^[g)'^{g)*) is invariant under left and right 
multiplication by elements in K, we have 

I-tt/2 

^) = 2 sin^ t sin 2t tr ($(a(t)^(a(t))*) dt. 
Jo 
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If we put r = tant for < t < 7r/2 we have 

1 

tr {^{a{m{a{t)r) = ^^(1 + r^)~^''+'-''^h,{T)W). 

1=0 

(See Section ^). Then 

2 / sYa^tsm2t ti{^{a{t)^{a{t))*) dt 
Jo 



" POO 

=4V / r=^(l+r2)-("+^+3-0/i.(r)/.(r)dr. 



1=0 ■ 

Thus the proposition follows. □ 

Proposition 7.2. (C°°(G) End(y^))^''-^ t/ien 

{Aj<^,^) = {<!>, A,^) J = 1,2. 

Proof. If we apply a left invariant vector field X £ q to the function 
(7 1-^ tr{^{g)^{g)*) on G and then we integrate over G we obtain 

0= / tr:iiX^)ig)^igr)dg+ [ tv mg)iX^){gr) dg. 
JG JG 

Therefore (X^,^) = -(<!>, X^). Now let r : gc — > Sc be the conjugation 
of Qc with respect to the real linear form q. Then — r extends to a unique 
antilinear involutive * operator on D{G) such that {D1D2)* = D2DI for 
all Di,D2 £ D{G). This follows easily from the fact that the universal 
enveloping algebra over C of g is canonically isomorphic to D{G). Then it 
follows that (Z)$,1') = ($,1)*^). 

Now H*^ = Ha, H*p = Hp ,X*= X_a, X^ = X* = X_^. From this 
it is easy to verify that A2 = A2 and A3 = A3. This completes the proof of 
the proposition. □ 

We now describe an alternative way to motivate the choice of inner prod- 



uct made before Proposition 7.1 



Start from the system in Corollary ^.15 . Introducing t = (1 + 
< t < 1, we get 

t (1 - t)hi -{{n + ^-i + 2,)t-{n + ^-i + l)) h[ 

+ - + 1) ^ _ ^ l{l-l^V)t ^ _^ = 4/li 



with /i^ = If D denotes the operator acting on the vector -ff(i) 

{hi{t), ■ ■ ■ ,h(^{t)) this can be put in the form 

DH{t) = DiH{t) + D2H{t) = \H{t). 

Here 



(1 - dt V dt 
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and 



/ij+i — hi ,, „ , ^ ... hi — hi 



{D2H){t) = {i-i){i + 1) ' _ i(£ _ i + 1) t 



l-t ' ' l-t 

The aim is to make D into a densely defined symmetric operator in some 
appropriate L? space. A look at Di suggests an obvious choice for an inner 
product among vector valued functions H{t) which are and compactly 
supported inside the open set (0, 1), namely 

i 1 

(13) {H,K) = y2 hi{t)ki(t){l-t)r+'~'dt. 

If one were trying to make Di symmetric, then each term in this sum could 
be multiplied by some arbitrary constant > 0. One check that the re- 
quirement 

{DH,K) = {H,DK) 

forces one to make the choice made above. A change of variables shows now 
that, up to a multiplicative constant, this is the inner product introduced 



before Proposition 7.1 



8. The C°° eigenfunctions of D 

This section contains material that is crucial in determining explicit ex- 
pressions for all the spherical functions associated to the complex projective 



plane. We display these results in Section 11 for some small values of £. 

In the process of obtaining these expressions we have uncovered what we 
think are interesting properties of eigenfunctions for the differential operator 
D. In order to keep the length of this paper within reasonable bounds we face 
a problem in deciding what to include here, as well as the level of generality 
aimed for in the proof of some of these statements. We have opted for a 
rather mixed approach whereby several lines of attack are described while 
proofs are given only in some simple cases. We are confident that all the 
statements made below hold true, even if some of the proofs that we have 
at this time are lengthy and rather unilluminating. The statements made 
below are strong enough that they can be used in Section ^ to prove that 
we have exhibited all the spherical functions of the pair {G,K). 

Some of these different ways of getting at the solutions might be useful 
in potential applications of this material. 



In subsection ST we describe all solutions of DH = XH in the case £ = 
and n an arbitrary integer. This is just a review of the classical theory deal- 
ing with the indicial equation and related elementary material. The analysis 
is powerful enough to show that we have written down all spherical functions 
when £ = 0. In this case, and only in this case, we give a complete analysis 
including the non-analytic solutions of DH = XH for all integer values of 
n. We also give, for £ = 0, the "limit point, the limit circle" analysis of H. 
Weyl that would be needed to discuss several possible selfadjoint extensions 
of the symmetric operator D. 
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Then we describe a way of constructing a 2{i + 1) dimensional space of 
solutions of DH = XH when £ is a non-negative integer. Here A is an 
arbitrary parameter. 

This construction is based on reducing a second order system of £ + 1 
equations to a scalar equation of order 2{i + l) and in observing, as the first 
in a string of miracles, that the corresponding differential operator has a 
nice factorization featuring the Gauss hyper geometric differential operator. 
This elimination process (from the bottom up) produces the last component 
of a (pair of) vector of solutions while the rest of the vector can then be 
trivially constructed by applying explicit differential operators to this last 
component. We then see how the entries in these column vectors can be 
used to give the first entries in a set of 2i other vector solutions of the 
same system DH = XH. Once again the rest of these vectors are built by 
applying to their first component differential operators that can be read off 
from the equation. This construction has some of the flavor of an unrelated 



"miracle" uncovered by T. Koornwinder in |18]. See his comments at the 
end of Section 1. 

The remarkable factorizations in Subsection 8.2 have not yet yielded to a 
a nice and general proof for all values of i. They have been established by 
use of computer algebra for £ in the range 0, 1, ... , 10. 

An interesting feature of this construction is that it expresses the solution 
in terms of differential operators acting on the Gauss function 2^1- Alter- 
natively one can express the solution as a linear combination of "shifted" 
versions of Gauss' function. 

We note that the elimination process mentioned above would fail if one 
were trying to apply it to determine solutions of EH = jsH. 

We start by recalling that the classical (scalar) equation of Gauss 

(14) (^t{l -t)(^^y + {c-{a + b + l)t)j^ - ab^ h{t) = 

has a two-dimensional space of local solutions ^{a, b, c; t) which for generic 
values of a,b,c has a basis given by 

^1 it) = 2F1 ( ; t) and ip2 (t) = t^-^aFi ( --+^:_^-^+^ ; t) . 

Any equation of the form 



can be solved easily in terms of these solutions. It is enough to introduce a 
parameter w as one of the solutions of 

H = —w{w + p) 

and to put a = —w, b = w + p. Notice that a different choice of a solution 
of the quadratic equation in w amounts to exchanging a and b above and 
that they enter symmetrically in (|T4[). 
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8.1. All solutions of iDH = \H for £ = 0. With the strategy just out- 
lined and the form of D given in (p!2[), we have with A = —'iw{w + n + 2), 



dV d 



- t) y—j + ((n + 1) - (n + 3)t)— +w{w + n + 2) j ho{t) = 0. 

For generic values of the parameters the functions 

v^Ut) = 2F1 ( ; t) and ij^it) = t-\F, ( . t) 

are linearly independent solutions. When n + lorl — nisa non-positive 
integer these expressions are of no use, and a more careful analysis is done 
below. 

Since the replacement oi w by — (u; -|- n -|- 2) does not change neither the 
equation nor the solutions ^wi'^w, we will consider these values as equiva- 
lent. 

We will show that for each integer w satisfying li; > and w + n>{) we 
have one solution of our equation that satisfies the conditions of Proposition 
|6.1| , namely 

(15) lini/io(t) = finite and non-zero 

and 

(16) 



if n = then lim^^o ^o(0 exists, 
if n / then limt_,o ho{t)t"-''^ = 0. 



8.1.1. Case n = 0. The functions ipwif) and ijjwit) coincide and give us one 
solution. This is a polynomial for w = 0, 1, 2, ... . For other values of w it 
behaves, close to i = 1, like a non-zero constant times (1 — . 
For w = —1, ipw{t) \s well defined and we get that 

are linearly independent solutions. Neither one of them nor any linear com- 
bination of them is bounded at both t = and t = 1. 
For w ^ —1, there is a unique solution of the form 



{log t) if^ {t) + ^ait\ 



0<i 



This is linearly independent of (pw{t) and blows up at f = 0. Therefore when 
n = we only have eigenfunctions meeting the asymptotic conditions ( p^ ) 
and ([T6D for w = 0,1,2, .. . (or the redundant set w = —2, —3, . . . ). 



8.1.2. Case n > 0. Now ipw{t) is well defined for all w, and it is a polynomial 
if w = 0, 1, 2, . . . . For other values of w (except the "redundant" values 
w = —n — 2, —n — 3, ... ) it behaves like a non-zero constant times (1 — t)~^ 
around t = 1. The function ipwit) is well defined and linearly independent 
of ipw{t) if = —n — 1, —n, . . . , —2, —1 and it is then a polynomial in t times 
The product t'^^'^ipwit) behaves like t""/^, and blows up, around t = 0. 
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If w ^ —n — 1, — n, . 



-2,-1, then there is a unique solution of the form 



{log t)(p^ (t) + Uif. 

This solution is linearly independent of ^Pwit) and its product with f"/^ is un- 
bounded at t = 0. Thus the only values of w where there is an eigenfunction 
meeting the conditions (15) and (|l6|) are w = 0,1,2, ... . 



8.1.3. Case n < 0. Now Tpyj{t) is always well defined, and it is a polynomial 
\n t ii w = —n, —n + 1, —n + 2, . . . (and also \i w = —2, —3, —4, . . . ). For 
other values of w it behaves like a non-zero constant times (1 — around 
t = 1. The function (pwit) is well defined if w = —1,0, 1, . . . , —n — 1, and 
it is in fact a polynomial in t which takes the value 1 at t = 0. It gives a 
solution that is linearly independent of ipw{t), and the product t'^/'^ipw{t) is 
unbounded at t = 0. 

If w ^ —1, 0, 1, ... , —n — 1, then there is a unique solution of the form 

(logt)V'^(t)+ ait\ 

0<i,i^—n 

This solution is linearly independent of ipw{t) and its product with t"'^'^ is 
unbounded at t = 0, since oq / 0. 

By going over the results given above we see that for each integer w 
satisfying w > and w + n > we have one solution of our equation that 
satisfies the properties given in Proposition 6.1. For values of w that do not 
satisfy these conditions (once one takes into account the symmetry between 
—w and w + n + 2 mentioned earlier) there is no solution of the equation 
that satisfies the conditions in Proposition 6.1. 

We stress that these conditions single out those solutions of our equation 
that correspond to spherical functions on G. They should not be construed 
as "boundary conditions" in the traditional sense of specifying a self-adjoint 
extension of our densely defined symmetric operator. 

In this regard we close the analysis of the case / = with the observation 
that for n = the end point t = gives a limit circle case (in the terminology 
introduced by H. Weyl) while t = 1 gives a limit point case. For n non-zero 
both end points are of the limit point type. These statements can easily be 
proved from the detailed description of the solutions given above. 



8.2. Solutions of ADH = XH, £ > 0. Consider now the system (|T2|) given 
in Section ^. We fix the values of {£, n) and A. Exploiting the tridiagonal 
nature of our system of equations we can eliminate -from the bottom up- 
all components of H(t) and obtain one equation in h£{t) of order 2i + 2, 

P2i+2 hit) = 
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where the following factorization holds 

(I) = -^^ (I) ('<i - *> (I) ' + (" + 1 - (" + ' + - ^) 

with (^) a differential operator of order 2i. For A = —Aw{w + n + £ + 2) 
and from the discussion in the introduction of the section, we can take for 
hi{t) any local solution in the space 

^{-w,w + n + i+2,n+l;t). 

components hi{t), i = 0, 1, . . . , ^ — 1 of a vector solution H{t) by applying 
to hi{t) differential operators of orders 2{i — i), 



These operators can be read off from the system 4DH = XH. In particular 

^0 (I) = /. 

Wc claim that from this vector solution (actually any vector in this two- 
dimensional space) we can readily obtain an extra set of i vector solutions 
(actually a 2£ dimensional space of such). 
Proceed as follows: Pick k = !,...,£ and consider the system 

ADH{t) = (A - Ak{n + k + l))H{t). 

Eliminate (from the top down) all components of H{t) except ho{t). At the 
last step one gets an equation of order 2£ + 2 for ho{t), 

M,,,, (I) = 



where another remarkable factorization holds, namely. 



Bu-2k\^j^j +iin + k + l)-{n + k + i + 3)t)--Xj . 

Here B4£_2k (^) is a differential operator of order 4£—2k and i?2(£-fe) (^) is 
the operator obtained from the i?2(£-fc) (^) introduced above by replacing 
n hy n + k. In consequence we can take for ho{t) anything in the space 

R2{£-k) j <^{-w, w + n + k + £ + 2,n + k + l;t) 

where w is now any root of 

A = -4w{w + n + k + £ + 2). 
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Just as before, from ho{t) one gets the remaining components of a vector 
solution H{t) by the recipe 

hk{t) = Q2k (^^) ho{t). 

In conclusion we have H{t) satisfying DH = 4{—w{'w -\-n + k + i-\-2) — 
k{n + k + 1))H , and the relation between w and the original A is given by 

A = -'iwiw + n + k + £ + 2)- 4A;(n + k + 1). 

Note that the first vector H{t), constructed from h£{t), corresponds to A; = 0. 
In a very explicit sense this hi{t) is the "seed" for the entire construction. 

The discussion above is summarized as follows: For a fixed {n,£) we 
associate to each integer k satisfying < k < i a two-dimensional space of 
solutions of ADH = XH. The solutions can be constructed fairly explicitly 
as the result of applying certain differential operators to solutions of Gauss's 
hypergeometric equation. The construction involves an auxiliary parameter 
w related to A by 

A = -Aw{w + n + k + e + 2)- 4k{n + A: + 1). 

The choice of one of the two roots of this quadratic equation does not affect 
the final result, i.e. the construction is invariant under the exchange of —w 
into w + n + k + £ + 2. 

The parameters k and w will reappear in Section 11. In that section we 
will use the results of Section |9| giving a parametrization of those solutions 
of 4DH = XH which correspond to spherical functions. The parameter A 
will be replaced by A/4. For the convenience of the reader we anticipate 
here that these conditions will turn out to be < A; < as above, and the 
extra requirement that w or —{w + n + k + £ + 2) can be chosen to satisfy 
the conditions 

< w , < w + n + k. 



An instance of these conditions was seen in Subsection |8.1| in the special 
case of ^ = 0. 

By using the well known differentiation formula 

2J"1 V c ' V c 2^1 \^ c+1 

one can re-express the components of different vector solutions H{t) of 
4DH = XH in terms of "shifted" version of 2^^!, as seen below. 

We give a fairly general formula for analytic solutions, at t = 0, when 
n > and then illustrate it in a couple of cases. 

For fixed i, and n > 0, and any integer < k < i we have a vector 
solution H^{t) with components 

^— max(fc,j) 
p=— min(fc,j) 
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Here A = —Aw{w + n + i + 2 + k) — Ak{n + A; + 1) and z{j,p) are appropriate 
coefficients. 

We include two examples, li i = 1 and A; = 1 we have, up to a common 
scalar multiple and for n > 

If ^ = 2 and k = 2 we have, up to a scalar multiple and for n > 

H'oit)=2F^r- ■,t), 

Hlit) = ^ (-(^ + - + 3) 2F1 ( — . 

ult+\ — (n+l)(n+2) / M,+n+3 77 / -to-2 , to+n+4 . A 
-«2l*j - (t„+„+5) I 2 2^ll n+1 

. (w+n+3) p / ,w+n+4 . ,N , 1 p / -lu , ■!«+ri+4 ,\ \ 

In Section 11 we will give more compact expressions for these solutions in 
terms of generalized hypergeometric functions. The relation between those 
expresions and the ones here can also be seen by using H and 0]. 



9. Parametrizations of spherical functions 

As we pointed out in Section |2|, there exists a one to one correspondence 
between the set of all equivalence classes of finite dimensional irreducible 
representations of G which contain the representation vr^^^ of K and the set 
of all equivalence classes of irreducible spherical functions of (G, K) of type 
(n,^). 

We need to quote a restriction theorem of finite dimensional irreducible 
representations of GL(n, C) to GL(n — 1, C) which we shall use. The equiv- 
alence classes of finite dimensional irreducible holomorphic representations 
of GL(n, C) are parametrized by the n-tuples of integers mi > m2 • • • > rrin 
in the following way: the diagonal subgroup of GL(n, C) acts on the highest 
weight vector, with respect to the Borel subgroup of all upper triangular ma- 
trices, of the representation T(,^^ ... „^^-) by tiEii + - • ■+tnEnn ' — ^ ■ ■ ■ t^" ■ 

If GL(n — 1,C) is identified with the subgroup of all (n — 1) x (n — 1) 
matrices of GL(n, C) in the following way 

GL(n-l,C)=. («L(n-i,c)o^^ 
then we have (see [^], p. 186): 



40 



F. A. GRUNBAUM, I. PACHARONI, AND J. TIRAO 



Proposition 9.1. When we restrict the representation mi > m2 ■ ■ ■ > rUn 

of GL(n, C) to GL(n — 1, C) it decomposes as the direct sum of the represen- 
tations ki > ■ ■ ■ > kn-i of GL(n — 1, C) such that mi > ki > m2 > k2 - ■ ■ > 
kn-i > iTT-n, 0,11 of thcsc with multiplicity one. 

Any finite dimensional irreducible representation oi G = SU(3) extends 
to a unique holomorphic irreducible representation of SL(3,C), and all of 
these are restrictions of holomorphic irreducible representations of GL(3, C). 
Moreover the highest weight of the restriction of ^mi,m2,m3) to SL(3, C) is 
A = {mi — m2)\i + (m2 — m3)\2 where Ai, A2 are the fundamental weights of 
SL(3, C) given by Xi{H) = xi and A2(-H") = -X3, for H = XiEu + X2E22 + 
xa^^ss Gsl(3,C). 

Now K = S(U(2) X U(l)) ~ U(2) and any finite dimensional irreducible 
representation of U(2) extends to a unique holomorphic irreducible represen- 
tation of GL(2, C). Thus a U(2)-irreducible subrepresentation of T(^mi,m2,m3) 
corresponds to a K-irreducible subrepresentation parametrized by a pair 
(n, £) G Z X Z>o which we want to determine. 

The parameter £ can be read off the action of the diagonal subgroup of 
SU(2) X {1} on a heighest weight vector of the subrepresentation {ki,k2) of 
U(2). Thus t'^i {t-^f^ = t^^-^^ gives t = ki- fca- 

The parameter n can instead be read off the action of the center of K in 
the {ki,k2) subrepresentation of U(2). Prom 



we get t^^t^ = i3(fci+fc2)^-2(mi+m2+m3). Therefore 2n + ki-k2 = ^{ki + k2)- 
2(mi + m2 + ms) which gives n = ki + 2k2 — mi — 777,2 — "^3- 



Now from the previous discussion we easily get 

Proposition 9.2. When we restrict to K the finite dimensional irreducible 
representation of G with highest weight A = pXi + qX2 it decomposes as the 
direct sum of the representations tt^/ of K given by n = ki + 2k2 — p — 2q, 
i = ki — k2 with p + q>ki>q>k2>0, all of these with multiplicity one. 

Proof. The irreducible representation of G with highest weight A = pAi + 
qX2 can be realized as the restriction to G of the representation T(^mi,m2,m3) 
of GL(3, C) with mi = p + g, 777-2 = Qj'ms = 0. Thus T(„ji.„j,,.m3) restricted 
to U(2) is the direct sum of the representations (ki, k2) with p + q'> ki > 
g > ^2 > 0, and a fortiori T^mi,m2,m3) restricted to K is the direct sum of 
TTn/ with n = ki + 2k2 — p — 2q, £ = ki — k2. The proposition follows. □ 

Corollary 9.3. The equivalence classes of irreducible spherical functions of 

(G, K) of type {n, £) can be parametrized by the set of all tuples {p, q,ki,k2) G 
such that p + q > ki > q > k2 > 0, with n = ki + 2k2 — p — 2q and 
£ = fci — /c2- Moreover if ^(p^q^kiM) ^ spherical function in the class 
{p,q,ki,k2) then 




^2^{p,qMM) = -| (P^ + 9^ + W + 3p + 3q) ^(p,qMM) 



MATRIX VALUED SPHERICAL FUNCTIONS 41 

Proof. The only thing that remains to be proved are the last two formulas. 
Since A2 and A3 are in D{G)^ they act as scalars in any finite dimensional 
irreducible representation of G. These scalars A(A2) and A(A3) can be 
computed by looking at the action of A2 and A3 on a heighest weight vector. 
From Proposition |3.1| it follows that 

A(A2) = - X{Haf - iA(Z)2 - 2A(F„) - 2A(Z), 
A(A3) =IXiH^f - IXiHpf + l\{H^fX{Hp) - IX{H^)X{Hfsf 
+ 8X{Ho,f + 'iX{H^)X{Hp) + 16A(F«) + 8X{Hp). 

Replacing X{Ha) = p, X[Hp) = q and X{Z) = p + 2g in the above expres- 
sions the proof of the corollary is finished. □ 

Going back to Proposition |4.1j we give in the following corollary the eigen- 
values A and corresponding respectively to the differential operators D and 
E in terms of the parameters {n,l,p,q). 

Corollary 9.4. We have 

1^ =4(|p^ - + ^p'^q - ^pq"^ + p'^ - + p- q) 
- 4(1^3 _ 2^3 ^ 1^2^ _ i^^2 ^ ^2 _ ^2 ^ ^ _ 

For a given (n,£) the four parameters (p, 5,^1,^2) are subject to two 
relations. One can introduce two integer free parameters k by means of 
the expressions 

ki = w + n + i + k, 
k2 = w + n + k, 

p = w + £ — k, 

q = w + n + 2k, 

which are consistent with the relations in Proposition |9.2| and it is easy to see 
that the four inequalities in this proposition are equivalent to the following 
four conditions: 0<w,0<k<£ and < w + n + k. We recognize here the 
conditions on mentioned in Section ^. 
In terms of this new parameters we have 

A = - 4w{w + n + £ + k + 2)- Ak{n + k + l), 

^"^^^ fi =A(n + 3k-£)- I2k{£ + I - k){n + k + I). 

10. The Analytic Eigenfunctions of D and E 

We take up the time honored method of formal power series expansions to 
look for simultaneous analytic eigenfunctions of the operators D and E. The 
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system (^) given in Section |^ was obtained from the one given in Corollary 
5.15 by making the change of variables t = (l + r^)~^ and we got 

t (1 - t)h'- +{in + i-i + l)-t{n + i-i + 3)) h[ 
^''^ +(£-^)(. + l)%^-^(^-^ + l)t^^i^ = A,, 



Similarly from Corollary 5.1(: we get the system 
(19) 

{n-i + 3i)t (1 - t)/i'/ - 3{i + - O^'+i 

+ {n- e + 3i){n + £-i + l-t{n + £-i + 3))h'i + 3i{i - i + l)t/i'„i 

+ {n + 2£- 3i){£ + 1) -{n + 2£- 3i)i{£ -i + l) 

-{2n + £ + 3)i{£ -i + l){h^- hi_i) = ^hi. 

If we change A/4 and ;u/4 respectively by A and fi and use matrix nota- 
tion, both systems are equivalent to DH = XH and EH = fj,H where the 
differential operators D and E are defined below. 

(20) DH = t{l - t)H" + (^0 - tAi)H' + y~^{Bo - tBi)H. 

(21) EH = t{l - t)MH" + (Co - tCi)H' + p-^Po + tDi)H. 

Here H denotes the column vector H = (/ig, . . . , /i^) and the coefficient 
matrices are given by: 

^1 = Eto(^ + ^-^ + 3)^ii, 
^0 = Eto(^ + - i)iEi,i+i - Ei^i), 
Bi = Eto^(^ - ^ + - Ei,i-i), 

M = Y!i=o{n-£ + 3i)Eii, 

Co = Eto(™ - ^ + 3i)(n + + l)Eii - 3ELo(^ + - 
Ci = Eto(™ - ^ + 3i)(n + £-i + 3)Eii - 3 ELo + 
Do = Eto(™ + 2^ - 30 (i + - - ^ii) 

- 3 ELo(" + ^ - i + l)i(^ - i + l)(^ii - ^i,i-i), 
^1 = Eto(2^ + ^ + 3)i(^ - * + l)(^n - ^i,i-l). 



Proposition 10.1. An irreducible spherical function ^ on G of type {n,£) 
corresponds to a function H that is analytic att = and satisfies DH = XH 
and EH = fiH for some A, /i G C. Moreover if n + £ < the function H(t) 
has a zero of order at least —n — £ at t = 0. 
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Proof. In the previous sections we already established that H is an eigen- 
function of D and E. 
that 



H(r) = (l + r2)"/2$ 



(l+r2)i/2 





(l+r2)i/2 


1 



(1 + ^2)1/2 

1 



^(l+r2)l/2 " (1+^2)1/2^ 

The first thing we get from here is that H{r) = H{—r). In fact we have 



1 







(l+r2)i/2 " (l+r2)i/2 

1 



V(l+r2)l/2 (l+r2)i/2 



1 










(• 


-1 


•)( 







-V \ 



1 



Moreover 




(l+r2)i/2 



— r 



and 




1 



(l+r2)i/2 


1 

(l+r2)i/2 



/ 1 

/ (1+^2)1/2 



— r 

V(l+r2)i/2 










)(• 


1 


-•) 














(l+r2)i/2 

1 







(l+r2)i/2_ 



commute because they are diagonal matrices in the basis {vq, . . . , vi}. Hence 
H{r) = H{-r). 

If we make the change of variable s = 1/r then the function H = H{s) is 
even and for s > we have 

/ S Q 1 

1 



His) = ^^'^i^^ 



(l+s2)l/2 



\(l+s2)l/2 U (^,^^2)1/2 



(l+s2)l/2 










Thus hi{s) is even and s"'~^^~^hi{s) is analytic at s = 0. Now in terms of 
the variable t = {1 + r^)~^ we have = t/{l — t). Therefore hi = hi{t) 
has a pole at t = of order at most when n + £ — i > 2. When 

n + i — i < 1, hi = hi{t) is analytic at t = and has also a zero or order at 
least - [^^^^] , when n + l-i<-l. 

If we put H{t) = '^j>rn ^''Hj, and assume that Hm / 0, with column 
vector coefficients Hj = {Hqj, . . . , H^j) e C^+^, then we have 



(22) 







for all j < 



n - 



On the other hand from DH = XH and ( 20 ) we get that the following three 
term recursion relation holds for all j 

[{j - l)(j - 2) + (j - l)Ai -Bi + X]H,^i 



(23) 



[2j{j - 1) + j{Ao + ^i) -Bo + X] Hj + (j + + Ao)Hj+i = 0. 
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From here for j 
(24) 



m 



1 we obtain 

m(m + n-\- ( 



0. 



Now assume that m < 0. From ( |24| ) we get Hi^^ 
For i = m + n + i we have 



< 



for all i 7^ m + n + . 



n + £ — i 




—m 


2 




2 



-m. 



Then from (22) we obtain Hi^m = 0. Thus Hm = 0, which is a contradiction. 
Therefore m > and H = H{t) is analytic at t = 0. 

To prove the last assertion suppose that n + i < 0. First observe that 
m > — [^^^] > 0. Now assume that m < —n — i — 1. Then m + n + £ — i < 
-1 - i < for all < i < Hence (||) impUes that Hm = 0, which 
completes the proof of the proposition. □ 

Thus we want to consider now formal power series H(t) = YlJLo 
with column vector coefficients Hj G C^^^. 

A formal solution of the system DH = XH and EH = fxH is then given 
by solving the pair of three term recursion relations given by (|23| ) and 

(25) 

[{j - - 2)M + (i - l)Ci +Di+ ii]Hj^i + {j + l){jM + Co)Hj+^ 



[2j{j - l)M + j(Co + Ci) -Do + i2]Hj 



0. 



Let V{X) denote the vector space of all formal power series H{t) = 
Y^jLo such that ([2^) holds. The differential operators D and E, closely 
related to A2 and A3, commute. Therefore E restricts to a linear map of 
V{\) into itself. 

Now we shall first consider the case n > where we have complete results 
and then we shall make some comments in the case n < 0. 

Let T] : V{X) C^+i be the linear map defined by t] : H{t) 1-^ H{0) and 
let L be the {£ + 1) x (i + 1) matrix given by 

(26) L = L{X) = Do-CoA^\Bo-X). 

Notice that n > insures that ^0 is invertible. 

Theorem 10.2. Ifn > then rj : V{X) C^^^ is a surjective isomorphism. 
Moreover, the following is a commutative diagram 

E 



V{X) 



V{X) 



Proof. The matrix j + ^0 is invertible for all j > since 
det(j + Ao) = n^=o(i + n + £-i + l). 
Therefore the recurrence relation (^3|) shows that the coefficient vector Hq 



H{0) determines H{t). This proves the first assertion. 
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To prove the second statement let H{t) G V{X). Then from and ( |23| ) 
we get 

rjiEHit)) = EH{0) = CoH'{0) + DoH{0) = CqH^ + DqHo 

= {-CoAq\Bo - A) + Do)Ho = LHo = L{rj{H{t)). 

□ 

In the next theorem we give the eigenvalues of the matrix L = L{X) and 
their multiplicities, as well as their geometric multiplicities. We have only 
partial results on the eigenvectors of L and we do not display them here. In 
Section 11 we write them down in the cases £ = 0,1, 2. 

Theorem 10.3. For any {n,i) G Z x Z>o the characteristic polynomial of 
the matrix L{X) is given by 



det{^i-L{X)) = llii^- i^k{X)), 



k=0 

where /Xjt(A) = X{n — I + 3k) — 3k{i — k + l)(n + k + 1) . Moreover, all 
eigenvalues /ifc(A) of L{X) have geometric multiplicity one. In other words 
all eigenspaces are one dimensional. 

Proof. Let us consider the polynomial p £ C[X, jj] defined by p{X, fi) = 
det(;U — L{X)). For each integer k such that < k < £let X{w, k) = —w{w + 
n+i+k+2)-k{n+k+l) and let ^kiX) = X{n+3k-i)-3k{i-k+l){n+k+l). 
Then from Theorem |10.2| and (^) we have 

p{X{w, k),fik{X{w, k)) = 0, 

for all If G Z such that < w and < w + n + k. Since there are infinitely 
many such w, the polynomial function w i-^ p{X{w, k), fj,kiX{w, k))) is iden- 
tically zero on C. Hence, for given k {0 < k < £), we have p{X, iJ,k{X)) = 
for all A G C. 

Now A = {A G C : /Xfc(A) = fJ-k'{X) for some < < A;' < ^} is a finite set, 
in fact I A |< i{i + l)/2. Since for any A, p{X, ^) is a monic polynomial in 
/i of degree i + 1, it follows that if A G C — A then 

e 

(27) p(A,/x) = n(/"-/^fe(A)) 

for all /i G C. 

Now it is clear that ( p7| ) holds for all A and all /i, which completes the 
proof of the first asertion. 

To prove the second statement of the theorem we point out that the 
matrix L = L{X) is a four diagonal matrix of the form 

I I i~\ 1-2 

L = ^ aiEi^i^i + ^ hiEi^i + ^ CiEi^i+i + ^ diEi^i+2, 

i=l i=0 i=0 i=0 
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with 

Oj = 3i{£ -i + l){n + £-i + l), 

b^ = X(n-i + 3i) - 3{i + - - 2i) - 3i{i - i + l)(n + £-i + l), 

c, = 3{i + -i){i-2i-{n + i- + 2){l - i + 1) + A)) , 

d, = 3{i + + 2){£ - i - 1){£ - i){n + £ - i)'^, 
for all 1 < i < £. 

If LH^ = fiHf, with Hf, = {ho,...,hi) £ C^+^ then for all < i < ^ we 
have 

aiXi-i + biXi + CiXi+i + diXi+2 = fJ-Xi, 
where we must interpret oq = Q = = = 0. From these equations we 
see that Hf^ is determined by xi, which proves that the geometric multiplicity 
of the eigenvalues of L is one. □ 

Corollary 10.4. For n > the formal solutions H{t) = X^j^g ^"'-^i ^/ ^'^''^ 
system DH = XH , EH = ^.H are parametrized, up to a nonzero multiplica- 
tive constant, by the eigenvalues /i of the matrix L = L{X). More precisely, 
if G C'^"*^ is a ^-eigenvector of L then 

oo 

r^-\H,)=Y,t=H, 
j=0 

is the corresponding solution. 

Notice that from the definition of rj it follows that Hq = H^. 

This concludes the discussion of the case n > 0. In this case none of the 
components of H(t) vanishes at t = unless H{t) = 0. 

When n < things are not so simple. The structure of the order of the 
zeros of the components of H{t) at t = 0, leads us to consider the following 
cases: n < —i and — £ < n < 0. A consequence of this structure is that the 
isomorphism rj introduced in the case n > must be redefined, as we do 
below. 

The partition of the integers in the form 

(28) Z = {n : n>0}U {n : -£ < n <0}U {n : n < -£} 

was already alluded to in the comments following Corollary 2.12| . 

When n < 0, H £ V{X) then we have H{t) = J2T>a where o = 



max{0, —n — £}. See Proposition 10.1 



If n + ^ < from (p3D, putting j = a — 1, we obtain aiHi^a = 0. Hence 
Hi^a = for 1 < i < i. Similarly a closer look at (^) reveals that Hi^a+k = 
for < /c < £ — 1 and k + 1 <i < £, and moreover that the map r] : V{X) 
C^+i defined by 

viH) = {Ho^a, Hi^a+i, ■ ■ ■ ,He,a+e) 
is a linear surjective isomorphism. 

If0<n + i<£ from (|22|) we get that Hi^o = for ah n + £ + 1 < i < £. 
But this does not follow from (p^). So in this case we should consider the 
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vector space T^(A) = {H e V{X) : Hi^ = , for all n + £ + 1 < i < ^}. Then 
it is easy to verify that the elements H G PF(A) satisfy 

Hi^k = for ah < < -n - 1 and n + £ + A: + 1 < i < 



which is stronger than (22). In particular iJj^i = for all n + £ + 2 < i < i. 
From this and (25) one can prove that the differential operator E restricts 
to a linear operator on W{X). Moreover from ( p3[ ) it follows that the map 
rj : W{\) C^+i defined by 

'n{H) = {Hofl, . . . , Hn+efl, Hn+e+1,1, Hn+E+2,2, • • • , H^^^n) 

is a linear surjective isomorphism. 

Notice that the structure of the order of zeros discussed above, insures 
that any analytic function H(t) in V{X) or W{X), depending on the value 



of n, meets condition ii) of Proposition 6.1. 

Unfortunately, the matrix L which completes the commutative diagram 
corresponding to the one given in Theorem [10.2 , in the two cases going with 



n < 0, is not as simple as the one obtained when n > 0. 

11. The spherical functions 

The purpose of this section is to combine results given in previous sections 
to give a fairly explicit expression for the spherical functions associated to 
the complex projective plane in terms of a particular class of generalized 
hypergeometric functions. We have the following results which have been 
verified, by use of computer algebra, for values of i up to ten, but for which 
we do not have yet a general proof. 

Conjecture 11.1. For a given i > 0, the spherical functions corresponding 
to the pair {£, n) have components that are expressed in terms of generalized 
hypergeometric functions of the form p+2^p+i; namely 



-0 ^•!(^)^ 



In the case n > we can give a more precise form of our results, namely 

Conjecture 11.2. For i > and n > the spherical functions are given 
by diagonal matrices corresponding to < k < i. For a given k the entries 
along the diagonal make up a vector H^{t), < i < i, with 

Hf{t) = Hf{Q) X 

( —vu— mm[i^k),w + n+l+k + 2 — mm.{i,k),{sj + l) 



The vector H^{0) is an eigenvector of L{X) defined in (p6|). The eigenvalues 
X, of D and E (see ( pO|) and (^Tj) ) are given by X = —w{w + n + £ + k + 
2) — k{n + k + l) and n = X{n — i + 3k) — 3k{i — k + 1). Finally (sj) denotes 
a row vector of i — \i — k\ denominator parameters and {sj + 1) the same 
coefficients shifted up by one. 
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Remark. By definition of tlie function p+2^p+i on the left-hand side of 
Conjecture 11.1 we have 



E 



{a)j{b)j{si + l)j 



-J . . . v-^p/j 



, Sp is given by 



Notice that the ratio of the p factors involving si, . 

[si +3){S2 + i) ■ ■ ■ {Sp + j) 
S1S2 ■■■Sp 

and this serves to define the polynomial 1 + dij + • • • + dpj'^ appearing in 
Conjecture 11.1 . 

The generalized hypergeometric functions p+iFp have not, so far, played in 
representation theory and/or harmonic analysis a role comparable to that 
of the celebrated case of Gauss and Euler, namely 2^1- An exception to 
this are the cases of p = 2, 3 , and a few other low values of p as well 
documented for instance in [Q]. Another very interesting exception to the 
statement above are the cases of the families ■^n-'J^in-b related to matrix 
entries for representations of U(n) discussed in and |22|. For arbitrary 
p the monodromy of the corresponding equation has been analized in Q . 

We observe that the special type of generalized hypergeometric functions 
that appear here do satisfy differential equations of lower order than the 
order p + 2 that one should expect. This has been observed for instance in 
[19|. We are grateful to M. Ismail for this reference. 

Next we give a guide that should allow the reader to see how the results 
in Sections |9| and 10, as well as Proposition |6.1| can be used to see that for 
^ = 0,1,2,... we are exhibiting all spherical functions of type We 
need to consider separately the cases: 

a) n > 0, b) n < , c) - ^ < n < 0, 

as indicated in (|28|). 

The results in Section ^ are complete for the case n > and simpler 
than in the other cases, and we start with it. 

arbitrary A G C we should pick as one of the eigenvalues /Ufc(A), < 
A; < £, of the matrix L{\). Then we determine as the properly nor- 
malized eigenvector. Starting with Hq = the three term recursion 



relation (|23| ) reduces to a two term recursion, and this leads to our hy- 
pergeometric functions in terms of a parameter w € C related to A by 
A = —■w{w + n + £ + k + 2) — k{n + k + 1). Since these hypergeometric func- 
tions remain bounded at t = 1 only when they are polynomials, we are forced 
to take w = 0,1,2, ... . Using the appropriate version of Gauss' summation 
formula we see that we can normalize -ff^ in order to get H(l) = (1, . . . , 1). 
Recall that we have shown that the corresponding diagonal matrix is a scalar 
matrix, 5.17 . Now Proposition 6.1 guarantees that H{t) in fact corresponds 
to a spherical function <I> on G of type {n,£). By refering to Section |^ one 
sees that we have a complete list. 
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It is remarkable that for the cases b) and c) the same machinery can be 
used, although we do not yet have the corresponding theoretical statements. 
The insistence on bounded eigenfunctions forces a different choice of w, 
which again is consistent with the conditions < w and 0<w + n + km 
Section ^. 

11.0. The case ^ = 0. We see that the complete list of spherical functions 
is given (up to a scalar multiple) by: 

a) Case n > 0. For w = 0,1,2, .. . we have A = —w{w + n + 2), jj, = nX and 

fw{t)=2Fl\^ ■,t 

b) Case n < 0. For w = —n, — n + 1, ... we have A = —w{w + n + 2), fi = nX 
and 



These results were already given, and proved, in Section ^. In this case the 
operator E is proportional to D. 

11.1. The case £ = 1. The complete list of matrix (or vector) valued spher- 
ical functions is given below. 

a) Case n > 0. We have two families of spherical functions corresponding 

either to the choice //0)A*i indicated in Section |l^ or the choice A; = 0, 1 

alluded to at the end of Section ^ and given in Section |l^. 

a.O) For k = 0, and w = 0,1,2, .. . we have A = —■w{w + n + 3), fj, = A(n— 1) 

and 

^0= ( ^~{^')^ 



Hit) 



^~Trn)^'^\ n+2, A-n-l ' 
,-1 / —w, w+n+3 , 
2^11 n+1 



a.l) For k = 1, and w = 0,1,2, .. . we have A = —w{w + n + 4) — n — 2, 
/i = (A-3)(n + 2) and 



H{t) 




w, w+n+4: , 
n+2 ' 
'Ui— 1, w+n+3, A ^ 
n+1, A-1 ' 



h) Case n < 0. Again we have two families corresponding to the choice 
/c = or 1 made in the case n> 0. 
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b.O) For A; = 0, and w = —n, —n + 1, . . . we have A = —w{w + n + 
ji = \{n — 1) and 



n, a 

w+3, —w—n 
1-n 



with a = —w{w + n + 3) — 2ra — 2. 

h.l) For k = 1, and w = — n, — n + 1, ... we have A = —w{w + n + A) — n ■ 
yi = (A-3)(n + 2) and 



w+3, —w—n—1 



b.-n IT f w+3, -w-n-1, b+1 \ 

with b = —w{w + n + 4) — 2n — 3. 



11.2. The case £ = 2. The complete list follows. 
a) Case n > 0. 

a.O) For k = 0, and w = 0,1,2, .. . we have A = —w{w + n + 4), n = A(n — 
and 



-I A(A-3(n+l)) \ 
^ ^ 2(n+l)(n+2) ^ 



1 



n+1 



/ / . A(A-3(n+l)) \ J. / 
+ 2(n+l)(n+2) J ^^^3 



Hit) = 



{l-^)3F2{ 



V 



2-^1 



w, w+n+i, si+1, S2+1 
n+3, si, S2 
-w, tu+n+4, S3+1 _ 
n+2, S3 

n+1 



;^) \ 



rn+4 \ 
1 ''^j 



with 



^^^^ ^ ^(^+3)(^+n+l)(^+n+4) ^ ^ ^^(^ ^ 3), 

Si + S2 = —w{w + n + 4) — n, 



S3 = - 



■»)('»)+n+4) _ n+1 
2 2 • 



a.ij For k = 1, and it; = 0, 1, 2, . . . we have A = —w{w + n + 5) — n 
/X = A(n + 1) - 6(n + 2) and 



Hn 



/ A \ 

' (n+1) (n+2) \ 
A+2 



(n+1) (n+2) '5^2 



A+2 
2(n+l) 



4F3 



3F2(-"'-^ 



2(n+l) 
1 



w, ■io+n+5, S4+I 
n+3, S4 
— ly— 1, to+n+4, S5+I, S6+1 
n+2, S5, S6 
«)+n+4, S7+I 
n+1, S7 
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with 

wjw+n+b) n+2 



S4 



2 2 



I ui(ui+n+5) 1 

S5 -r 2 2' 

(to+l){ty+?i+4)(ui^+nM)+5ui+n) 

^5^6 — 8 ) 

_ {w+l){w+n+4) 



S7 = - 



2 



a.2) For k = 2, and = 0, 1, 2, . . . we have A = —w{w + n + 6) — 2n 
/X = A(n + 4) - 6(n + 3) and 




with 



^ {n+2)in+l) ( 



Hit) 



2 

' n+l 



n+3 

p / -w-1, w+n+5, S8+1 
1^ n+2, 6-8 

-iu-2, M)+n+4, sg+1, sio+1 
n+l, sg, sio 



■,t 



S8 



ui(ui+n+6) _ ra+5 
2 2 ' 



_ {w+l){w+2){w+n+4){w+n+5) 

sg + sio = —w{w + n + 6) — (n + 6). 



6j Case n < —2. We have, as above, three famihes going with the choices 
A; = 0,1, 2. 

b.O) For fc = 0, and w = —n, —n + 1, . . . we have A = —w{w + n + 4), 
II = A(n — 2) and 



Hit) = 



( r"-V3( 



w+2, -w-n-2, si+1, S2+I . A \ 
-n-1, si, S2 ' ' 

w+3, — w— n— 1, S3+I 
-n, S3 

2 +—n _T? f w+i, —w—n. 

-n+l 



with 



_ (M)+2)(M)+3)(M)+n+l)(M)+n+2) 
S1S2 — 2 : 

Si + S2 = —w{w + n + 4) — 3n — 4, 
ss^- '^'t"^^^ -i(n + l). 
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b.l) For k = 1, and w = —n — 1, n, — n + 1, . . . we have A = —w{w + n + 
5) - n - 2, /i = A(n + 1) - 6(n + 2) and 



H{t) 



(A-2n) ^-„-l p 
2(n+l)'' ^f'S 



u)+3, — ui— n— 2, 



— n— 1, si 
«i+3, — uj— n— 2, S2+1, S3+1 . 



\ 



V 



— n, S2, S3 
ui+4, —w—n—l, S4+1 , 



n(n+l) 71 

with si, S2; 53, S4 given by the expressions 

{w+Z){w+n+2){w'^+nw+5w+3n+1) 



S2S3 
S2 + S3 
Si 
S4 



«)(«)+n+5) _ 4n+5 
2 2 ' 

t»(tD+n+5) _ (3ra+6) 
2 2 ' 

«)(M)+n+5) _ (3n+4) 
2 2 



For k = 2, and w = — n — 2, — n — 1, —n ... we have A = —w{w + n + 
6) - 2n - 6, = A(n + 4) - 6(n + 3) and 



V 



A 

n+1 

(A-2)(A+1) _ A+2 \ 
2rt(7i+l) 2(n+l) ) 



n— 2 r-i / ui+4, — to— n— 2 
2^' 

1 1 3^^ 

t-"4F3 



-n-1 

to+4, — tu— n— 2, si+1 . 
2 \ — n, si 

«)+4, — ui— n— 2, S2+1, S3+I 
—n+1, S2, S3 ' 



with si, S2, S3 given by 

■w{w+n+&) 3n+7 



Si 



2 2 ' 

w(w+n+6){?i)(ji)+n+6)+5n+13) , ,^9^2 



S2S3 = -"-"^ ' ' + (3n^ + 15n + 20), 

S2 + S3 = —w{w + n + 6) — (3n + 6). 

Finally, we come to the exceptional situation that arises when — / < n < 0. 



c) Case n = —1. As in all the previous situations there are three families 
of spherical functions, corresponding to the choices A; = 0, 1, 2. We observe 
that the expressions for ^a;(A) in Section 10 are still valid when n < 0. 

c.O) For k = 0, and w = 1,2,3, .. . we have A = —w{w + 3), /i = — 3A and 



Hit) 



and we have 



-to, ui+3, si+1, S2+I 



^ 4F3 ( 2, SI, S2 

w(w+3) 

V 



w, to+3, S3+I J. 

1, S3 



w{w+3) 



t2Fl 



1— to, tii+4 . 



■,t) J 



S1S2 
Si + S2 
S3 



2 
„2 



-W 



3w + l, 



w{w+3) 
2 • 
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c.l) For A; = 1, and w = 0, 1, 2, . . . we have A = —w{w + 4) — 1, 



H{t) 



3F2 



-UI, ui-l-4, si+l . 



(w^+4w-l) rp 



2, si 

«)— 1, w+3, S2+1, S3+I . . 



i 3^2 



—w, «i+4, si+1 . 



2, si 



with 



t»^+4ui+l 



S2S3 
S2 + S3 



•Si - 2 ' 

(w+l)(w+3)(w^+4w-l) 
8 ' 
ui^+4m)-|-1 



-6 and 



Remark. Note that in this case H2{t) = tHo^t). 

C.2) For k = 2, and w = 0,1,2, .. . we have A = -w^w + 5) - 4, /i = 3A - 12 
and 



-3^2 



1, 10+4, si+1 



1, Sl 



\^ -^{w + l){w + 4)t4F3 



-w—1, 10+4, S2+1, S3+I . 



with 



si 



(w+l)(io+4) 
2 ' 



(tO+l)2(«,+4)2 

S2S3 = - — — 

S2 + S3 = -{w^ + 5w + 3). 

12. A MATRIX VALUED FORM OF THE BISPECTRAL PROPERTY 

In the case of i = when our spherical functions are scalar valued and 
reduce to the well known case of Jacobi polynomials, one has a three-term 
recursion relation giving the product of t times (pwit) as a linear combina- 
tion, with coefficients independent of t, of the functions (j)w-i{t), 4'w{'t), and 

The reasons behind this fact are well understood in terms of tensor prod- 
ucts of representations. At a more elementary level this is just a consequence 
of dealing with a sequence of orthogonal polynomials. 

From a different point of view this three-term recursion relation, along 
with the differential equation in t satisfied by (j)w{t), can be seen as a basic 
instance of the "bispectral property" discussed in a more general context, 
first in [Q] and subsequently in a variety of related contexts by several au- 
thors. For a good reference showing connections of this problem with lots 
of other areas see |]lO|. In this field the basic cases play a very crucial role, 
since they give rise to entire families of nontrivial bispectral situations by 
repeated applications of the Darboux process. 
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We finish this paper by displaying a rather intriguing matrix valued three 
term recursion relation that we have found for our spherical functions. We 
have not investigated the reasons behind it and we do not claim that this 
is the most natural such recursion in our context. We expect however to 
return to this problem in the future. In fact, since the initial version of this 
paper was completed we have made substantial progress in establishing the 
results illustrated below and the interested reader may want to see Q. 

For given nonnegative integers n, i and w consider the matrix whose rows 
are given by the vectors H(t) corresponding to the values k = 0,1,2, i 
discussed above. Denote the corresponding matrix by 

^{w,t). 

12.1. The bispectral property. As a function of t, ^{w,t) satisfies two 
differential equations 

D^{w, tf = ^{w, tfK, E^{w, tf = ^{w, tfM . 

Here A and M are diagonal matrices with A(i, i) = —w{w + n + i + i + \) — 
{i - l)(n + i), M{i, i) = A(i, i){n - i + 3i - 3) - 3{i - l){£ - i + 2)(n + i), 
1 < i < £ + 1; D and E are the differential operators introduced in ( pO| ) and 
(^Tj). Moreover we have 

Theorem 12.1. There exist matrices A^, B^, Cw, independent oft, such 
that 

A^^{w -l,t) + B^^{w, t) + Cu,^{w + l,t) = t^{w, t) . 

The matrices Ayj and consist of two diagonals each and -B^ is tridi- 
agonal. Assume, for convenience, that these vectors are normalized in such 
a way that for t = 1 the matrix ^{w, 1) consists of all ones. 

We display below the formulas in the case ^ = 2, n > 0. We leave the £ 
dependence quite explicit in these formulas to indicate how things go in the 
general case. If we are not in the case 1 = 2 the multiplicative factor 2 in 
the off-diagonal elements of the three matrices below has to be altered. 

The nonzero entries of the matrix A^ are given as follows 

Ay,{i, i) = w{w + £ + l)(ii; + n + z- \){w + n + ^ + + i + 2)'^ 

X + n + 2i - \Y^(2w + n + ^ + i)~^(2u; + n + £ + i + 1)"\ 

A^{i, i + 1) = 2w{w + £+ l){w + £-i + lY^{w + £-i + 2)'^ 

X {w + n + 2i- iy^{2w + n + l + i + 1)~^ 

Notice that if tt; = we have = 0. This is useful since we have not 
defined <I>(-l,t). 

The nonzero entries of the matrix C^] are given as follows 

={w + l){w + £ + 2){w + n + i){w + n + £ + i + l){w + £-i + 2)"^ 
X {w + n + 2i- iy^{2w + n + £ + i + iy'^{2w + n + £ + i + 2)"\ 
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Cuj{i + l,i) 

=2{w + l){w + e + 2){w + e-i + 1)-^ 

X {w + £-i + 2y^{w + n + 2i + l)~^{2w + n + £ + i + 2)^^ 

Now we come to the matrix B^. This one is tridiagonal and only its off- 
diagonal elements have a pleasant expression. We have 

B^{i + 1, i) =2{w + n + i){w + n + £ + i + l){w + £ - i + 1)"^ 

X {w + n + 2i)''^{w + n + 2i + iy'^{2w + n + £ + i + 2)"\ 

B^{i - 1, i) =2{w + n + i - l){w + n + £ + i){w + £ - i + 3)"^ 

X {w + n + 2i- 3y^{w + n + 2i- 2Y^{2w + n + £ + . 

The expressions for the entries in the main diagonal of i?^ are given below. 
For Byj{\, 1) we get 

5^(1, 1) ={z{2z + + lOn + 13) + 2{n + l)(n + 3)(n + 4)) 

X (w + 2)-^{w + n + 2)-^{2w + n + 3)"^(2u; + n + 5)-\ 

with z = w{w + n + 4). For Byj{2, 2) we get 

5^(2, 2) ={q{q{2q + (n + 2){n + 12)) + A{n^ + lOn^ + 28n + 28)) 

+ {n + 4)(3n^ + 2An^ + 56n + 56)) {w + iy^{w + 3)"^ 

X {w + n + 2y^{w + n + A)~^{2w + n + A)~^{2w + n + 6)"\ 

with q = w(w + n + 5). For i?tt,(3, 3) we get 

B^(3, 3) ={y{2y + + lOn + 29) + 2(n + f)){r? + 5n + 10)) 

X {w + 2)~^(u; + n + A)~^{2w + n + 5)"^(2u; + n + 7)"\ 

with y = + n + 6). 

Observe that the matrix Cyj is invertible if > and n > as we are 
assuming in this section. This allows one to determine ^{w,t) from <I>(0, t) 
and ^>(l,t) for ah w = 2,3, . . . . 

13. Appendix 

For completeness we include here the proofs of those propositions and 
lemmas given, without them, in Sections 4 and 5. 

Proposition For H G C'^{C'^) (g) End(K) we have 
Di{H){x,y) = 

(1 + |X|2 + |y|2) ( (K^^^, + H^.,.,){1 + |X|2) + {Hy,y, + Hy,y,){l + 1^^) 

+ 2(i^yixi + Hy^xi) Re(xy) + 2{Hy^^^ - Hy^^^) Im(xy)) . 
Proof. We have 

D^{H) = -A{X_pXp + X_^X^){H) = {Yi + Yi + Y^ + Yi) (H). 
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We begin by calculating Y^{H){g), for all g A. We have 

Yi{H){g) = {piaeMs + t)^))) • 

Let 

. ,s _ 912 tan(5 + t) + ffi3 r +\ _ g22 tan(g + t) + g23 

"Ul 5, 6 ) — r 3)110. VyS^Z) — z r . 

532 tan(s + + fl'as 532 tan(s + t) + 533 

Then 

p{g exp(s + t)Yr,) = {u{s, t) , v{s, t) , 1). 
Now using Lemma p.7| we obtain 



5u\ _ 512533-913932 _ -521 



^^Js=o (532 sin t + 533 cos t) (532 sin t + 533 cost)' 
and 

'^■uN 522533 - 523532 5ll 



.dsJg^Q {g32smt + gsscostf (532 sin t + 533 cos t)^ 
Therefore at s = t = we have 

5m 9m §21 5ii 

ds dt ' ds dt (733 

and 

^ 2g32g21 ^ -2532511 

Similarly let 

~f ,^ _ «5i2tan(s + t) +gi3 . . _ i 522 tan(s + t) + 523 

1 532 tan(s + t)+ 533 1 532 tan(s + t)+ 533 

Then we obtain p(5exp(s + t)YQ) = {u{s,t) , v{s,t) , 1). So, at s = t = we 
have 

du du ig2i dv dv ign 
ds dt 533 ' ds dt 533 

and 

d'^u ^ 2g32ff2i "9^^^ ^ 2g325ii 
^33 ' 9s9t (733 
By using the chain rule we have 

Yi{H){g)= ^ —I + ^ ^....^^ 

«J=1,2 i,j=l,2 



+ 2^ dt ^ dt ds)^ ^ ""'dtds^ "^'dtds 

and 

i,i=l,2 i,i=l,2 
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"'^^ \ds dt^dt ds)^ ^ ^'dtds^ '''dtds- 

i,j=l,2 ^ ^ 1=1,2 



We note that if u{t) = ui{t) + iu2{t) then ^ = Re(^) and ^ = Im(^). 
Therefore 



(29) 



{Yi + Yi){H){g) = {H^,.,, + H^,^,) ^ + {Hy,y, + Hy,y,) ^ 

1933 1 1533 1 



2Re(ffiig2l) trj ,rr N _ ^M5ll92l) /o- _ o- ^ 

I 14 \^x-iyi 'T 11x2112 ) I 14 \-'^X2yi '"-xiy2) 

15331 15331 

We proceed in the same way with + Y^ and obtain 
(30) 

Iff22|^ |5l2p 

(Yg + y4 )iH){g) = (i^xixi + -f^xaxa) I 14 + (-f^j/ij/i + -^^^21/2) 1 [4 

15331 15331 

2Re(ffi2522) ,0- N _ ^M5l2522) / o- _ o- N 

I ,4 y-'^xiyi ~r -nx2y2) 1 14 l-"2:2yi ^xiy2) 

15331 15331 

Hence 

(z)i)(i/)(g) = {Yi + y4')(^)(5) + (1^5' + yimm 

_(rr ,rr ^ " l523p) ^ X (1-1513^) 

15331 15331 

lOZ-H- -L H- N 5:^(513523) , r, / rr _rr ^ Im(gl3g23) 

"T ^ l^-"2:i2/i "T -"X22/2 J l„_„|4 "T ^ 3:^22/1 -"2:12/27 1 14 



15331 1533 1 

Now, using the proposition fohows. □ 

Recah that the open dense subset ^ of G was defined by the condition 
(let{A{g)) 7^ or equivalently by 5(33 7^ 0. 

Lemma 13.1. For any g £ A let B = {if A and C = (f^ °) . Then 



^0 923 J \g23 

i) {X^p<i>M = HBA{g)-^)7T{A{g)). 

ii) {X^^^^)ig) = n{CA{g)-^)7T{Aig)). 

Proof. Upon considering the unique holomorphic representation of GL(2, 
which extends tt we may write 

$^(5 exp tX_p) = TT{A{g exp tX_p)A{gy'^) TT{A{g)) 

for |t| smah. Moreover we have 

(X_^$^) {g) = $^(5 exp tX^p). 



dt 



t=o 
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Therefore 

(X_^<I>,)(<7) =7^ ((^^(5 exp o^^^^^O 

A{g exp tX^n) = B, 



Since 

d_ 
It 




i) follows. In a similar way one establishes ii). 
Proposition For H e C°°(C^) ® End(F^) we have 
D2{H)ix,y) = 

^^""Vya + ixH x\y\y v^^^ + 

Proof. We have 

Z?2(^^) = -4 (X^(i7)X_^(cI>0cI,-l + X^(i/)X_^(cI>^)cI>;l) . 
By Lemma |13.1| , for any g^Awe have 

rf. M / \-l ^ ■ f~ 913921 gi39ll\ 



\- 923921 923911/ 

and 

1 . / 513922 -513512 ^ 

— vr 

533 V 523522 —523512 

Also, by Lemma |2.8| we have 



, , f^-f^ 5ii dH . ^ , , dH g^2 dH 

5|3 dx ay dx 5y 

Hence 

Z)2(i?)(5) =-U^^-^^) '''''' 

.533 5§3 9y J 933 V 523521 -523511 



('522 ^ _ 5l2 ^\ ^ ^ f -913922 513512 
,533 9^ 9h 9y J 533 V -523522 523512 



where 



p _ 521 / 513521 -513511 \ _^ 522 ( 913922 -513512 



533I533P V523521 —523511/ 533I533P V523522 —523512 



]^ /(I521P + |522p)5l3 -(511521+512522)5 



13 



I 1 2 I 

53315331 \ (1^21^ + |522p)523 -(5ll521 + 512522)523/ 
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533 1 533 1 



2 



'(1-1523^)513 5?3523 \ + x'^y' 

,(1-|523P)523 5l3l523lV W + 1^1') Av? 



In the last two steps we have used that g G SU(3) and that x = 513/(733, 
y = 523 / 533 • If we proceed in the same way with Q we complete the proof 
of the proposition. □ 



Proposition For H e C°°(C2) End(T4) we have 
Ei{H){x,y) = 



(i + l^l' + |y|') 



yn^^xi ^ J^X2X2) \ g 2(1 + 



Wl 2xy-xy -3(1 + jyp) 



^..f, _rr . . /-(2xy + xy) -3(l + |y|2)\ 
^^i^^^^V 3(l + |x|2) 2xy + xy 

Proof. We have 

(31) 

Si(i/) = -4{X_^X^iH)) $^^(iJi)$-i -4(X_^X^(F)) $^^(#2)^"' 
+ 12 {X.pX^iH)) ^^n{X^a)K^ + 12 (X^^X/siH)) <^^n{Xa)<^^\ 

In (|9l) and @) we have calculated -4 (X_^X^(i7)) = {Y^ +Yi){H) and 
-4 (X_^X^(i7)) = (^3^ + Yi){H). Now we shall compute 

(32) -AX.pX^iH) = (Y^Ys + YqY^) (H) + i (Fels - ni"4)(^). 

For U,V G Q and 5 G ^ we have 



UV{H)ig) = (^^^^^H{p{gexpsU exptV))^ 

If \ t\ are small we can write 

p{gexpsU expty) = (x(s,t) , y{s,t) , 1). 



s=t=0 
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Also if we put xi = Re{x), xi = Im(a;), yi = Re{y) and y2 = Im(y), the 
chain rule gives 



ds dt ^ dt ds ) ^ ^/'""'dtds^ ^'dtds 



dxi dyj dxi dyj\ , d'^Xi d'^yi 



i,j=l ^ ^ i=\ 

For U = Y^ and F = we have 

511 tan t + 5i2 sin s + 513 cos s 



x{s, t) 



531 tan t + 532 sin s + 533 cos s 

and 

521 tan t + 522 sin s + 523 cos s 



531 tan t + 532 sin s + 533 cos s 
Moreover at s = t = wc have 

dx^_g2i 5x^ 522 dy ^gii dy _ 512 

ds 5I3 ' at 523 ' ds 5I3 ' at 523 

For U = Yq and F = I4 we have 

i 511 tan t + i 512 sin s + 513 cos s 



x{s, t) 

y{s,t) ■ 



i 531 tant + i 532 sin s + 533 cos s 

and 

i 521 tan i + i 522 sin s + 523 cos s 



i 531 tan i + z 532 sin s + 533 cos s 
Moreover at s = t = we have 

dx ^ _i52i ^ ^ ^g22 ^ ^ ^ffii ^ ^ _!Zi2 

533 ' 533 ' ^« 533 ' 533 ' 

For [7 = 16 and F = Ys we have 

, 511 ^ ^111 / + ' <7i2 f-iii -s + (/l:-! COS s 

xis t) = 

531 tSLut + i 532 sin s + 533 cos s 

and 

521 tant + ? 522 sins + 523 cos s 

y{s,t) = : . 

531 tant + i 532 sm s + 533 cos s 

Moreover at s = t = we have 

dx ^ Z521 5x^ 522 &y^ijii dy ^ 512 

9s ~ 5i3 ' ~ sis ' ~ 533 ' ~ 933 ' 

For [7 = 15 and F = I4 we have 

i 511 tan t + 512 sin s + 513 cos s 
i 531 tan i + 532 sin s + 533 cos s 

and 

i 521 tan t + 522 sin s + 523 cos s 



x{s, t) 

y{s,t) ■■ 



i 531 tan t + 532 sin s + 533 cos s ' 
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Moreover at s = t = we have 

ds g^^ ' dt gl^ ' ds gl^ ' dt gj^ ' 



Now if we add the four terms in the right hand side of ( p2| ) and ob- 
serve that taking the real or imaginary part of a complex valued function 
commutes with taking a derivative, we obtain 

15331 15331 

, (gllg22 + 521512) ^ , TT ^ i (511522 - 521512) r ZJ _ zr N 

+ 1 14 K-'^xiyi ~r -tix2y2) i 14 {^X2yi ^xiy2) • 

15331 15331 

In order to compute we observe that 

-AX.^X(,{H) = (ygls + nie) (^) + i - ^3^6) (^) 

= (nis + >6n) (ii-) - i (I6I3 - nn)(^), 

since if X G £ then X{H) = 0. Therefore it is easy to verify that 
- 4:X^^Xp{H){g) = -^P^ {Hx^xi + Hx2X2) - T^%" (-^^2/13/1 + -^^2/22/2) 

|533| |533| 
, (522511 +512521) /u ,0- ^ ^(522511 -512521) _ N 

"T I 14 V-"a;iyi i" -"a::2S/2J 1 14 V-"3;2yi ^Xiy2) ■ 

1533 1 |533| 



On the other hand we have 
(33) 



^.^(5)^(^1)^.(5)"' = ^ (^(5)^1^(5)"' 



1 . / 2^11 322 + 512521 -3511512 
= — 

533 V 3521522 -511522 - 2512521 



^ f \ - / \-i ^ ■ -511522 - 2512521 3511512 

$.(5)7r(i?2)^>7r(5) = — TT 



533 V -3521522 2511522 + 512521 
$.(5)^(X^.)$.(5)-' = ('"2'" 1 , 

533 V 522 -512522/ 

^.(5)^(X.)cI>.(5)-' = ^^f-^T V 

533 V -521 511521/ 
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Now, by (|3l|), the function multiplying Hx^xi + ^^2x2 is a matrix Tr{A) 
where A is given by: 

_ Ig2i P 2giig22 + gi2g2i -3511512 \ 

l533|'^ff33 V 3521522 -511522-2512521/ 

I522P /-5llff22 - 2512521 3511512 \ 



1 533 1 ^533 V -3521522 2511522 +512521 y 

3521522 512522 -5l2 \ , 3521522 / -511521 5ll \ 



^ 15331^533 V 522 -512522 y ^ |533|^533 V "521 5ll521 7 

If we recall that 5 G SU(3), x = 513/533 and 5 = 523/533 then the coeffi- 
cient ^11 of A can be written in the following way, 

^11 =j^^^^=— (|52i|^(-5ii522 +512521) + I522 1 ^(-511522 +512521)) 

_ -(|521P + |522p) _ -(1-|523P) 
I533I" |533|^ 

= -(l + |x|2)(l + |x|2 + |5|2). 
Similarly, 

1 2 

-422 = |g33|4ggg (l^2l|^ + I522H (-2521512 + 2511522) = (1 - |523n 

=2(l + |x|2)(l + |x|2 + |y|2). 
We also have ^21 = and 

^12 =-. (3511521 (-521512 + 511522) + 3512522(511522 - 521512)) 

1 533 r 533 

3 ^ , „ ^ X -3513523 



(511521 +512522) 



|533|^ ' — ^ |g33|4 

= -3xy(l + |x|2 + |y|2). 

Analogously we calculate the functions multiplying Hy^^y-^ + -f^j,2j/2i ^yi^i + 
Hy2X2-, Hx2yi — Hxiy2 and complete the proof of the proposition. □ 

Proposition O. For H G C°°(C2) ® End(T4) we /laue 



E2iH){x,y) = 

^ai// /Ox\ / -2x5 0\ ^/a;0\ /I + |x|2 3xy 

a^V VOyy V3(i + k|2) xyj "^^Vy oy o -2(i + |x|2) 



Proof. We have 

£;2(^) = -4X^(//)X_^($07r(^i)$;^i -4X^(i/)X_^($^) 77(^2)$;' 
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For any g £ Awe have, by Lemma 



921 dH ^ dH 
ah dx -2 



533 



{X,H){g) 



922 dH gi2 dH 
ais dx gh dy ' 



and by Lemma 13.1 



1 

533 

1 
933 



TT 



■ TT 



In (p^ we computed <I>^(g)7r(^)$^(g')~^ for A 

dH 

dy 

921 



Therefore, E2{H) = P + with 



-513921 513511 \ 

-523521 523511 / ' 

/ 513522 -513512 \ 
V 523522 -923912 J ' 

H\jH2,X^a and Xq^. 



P 



■ TT 



1533 I 
522 
1533 I - 

3522 
1 533 I 

3521 
1 533 I 



■ TT 



■ vr 



■ vr 



/ 513521 -513511 \ 

V 523521 -523511/ 
513522 513512 \ 
523522 523512/ 

/ 513521 -513511 \ 

V 523521 -523511/ 
513522 513512 \ 
523522 523512/ 



vr 



vr 



vr 



vr 



2^11522 + 512521 -3511512 

3^21522 -511522 - 2^12521 

-511522 - 2^12521 3^11512 \ 

-3^21522 2^11522 + 512521 / 

/ 512522 -5^2 A 
V 522 -512522/ 

-511521 5?i 
-5ii 511521 



If we combine the first and third terms and the second and fourth terms, 
and use Lemma 2^ several times we obtain 

1 . / 013021 -513511 
-523511 



P 



■ vr 



15331 
X vr 

+ 



1 



1533 



X vr 



/ 513521 
V 523521 
2^22513523 - 512(1 - 1523^) 

-3522(1 - |523P) 2512(1 
513522 513512 \ 
523522 523512/ 

2521513523 - 511(1 - |523p) 



vr 



-3521(1 - I523I 
Hence using (0) we get 



2511(1 



-3512513523 
|523p) - 522513523 



-3511513523 
|523p) - 521513523 



1 



■ vr 



1533 
X ^TT 
1 

+ 



1533 1 



■ vr 



/ 513521 -513511 

V 523521 -523511 

2522xy 
3522(1 + \x\^) -922xy 

513522 513512 \ 
523522 923912 J 



-512(1 -35i2xy 
2512(1 + |x|2: 
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y^fj^f '^92ixy \ /-c/ii(l + |xp) -3guxy 

V V-352i(l + |xP) -g2ixyj { 2gnil + \x\^] 

Thus, 

p ^ 922 ^ f 913921 -913911 V 2xy 

bssp V 523521 -523511/ V-3(l + kp) 
_^ 521 ^ f -913922 513512 \ ^ / 2xy 

l533p \- 923922 923912/ \-3{l + {xl"^) -xy 
, 512 . f 913921 -9i39ii\ . + -32;y 



|533p V523521 -923911 J \ 2(l + |x|2) 

, 511 . [-913922 9i39i2\ . + -3xy 

|533p \- 923922 923912/ \ 2(l + |x|2)y' 



Now, using Lemma 2.7 we obtain 
p^J_.(0 -913933]. f 2xy 



533p \0 -923933/ V-3(l + |2;|2) -xy 

1 ^(^-513533 0\ /-(l + |x|2) -3xy 
|533P''V -523533 Oy'^'V 2(l + |x|2) 
_ . /O x\ . / -2xy \ . /x 0\ . /I + |x|2 Sxy 
VO V3(l + |x|2) xyj ^""U Oy V -2(l + |x|2] 

If we proceed in the same way with Q we complete the proof of the propo- 
sition. □ 

Now we shall compute all first and second order partial derivatives that 
we used in Section ^. We start with the following immediate results. 

Lemma At (r, 0) G We have 

dH d^H 
^^xi(^O) = — (r) and F^^^i (r, 0) = -^^-(r). 

As a preparation to other computations, given (x,y) G C^, x = Xi + ix2 
and y = yi + iy2 we need to choose an element in K which carries the point 
(x,y) to the meridian {(r, 0) : r > 0}. We take 

^(x,y) = (^^ G SU(2) where s(x,y) = y/\x\^ + \y\^. 

Then (x, y) = A{x, y) (s(x, y), 0) and 

H{x,y) = Tr{A{x,y))H{s{x,y))7r{A{x,y)-'). 

For simplicity we shall use the notation (ni, U2, M3, 1*4) = (xi, X2, yi, y2)- 
As usual we denote [A, B] = AB - BA. 

Proposition 13.2. At (r, 0) G we have 
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and 



duiduj 



duiduj duiduj 



L V dr . 



vr 



V Sit,- / V 3u,- / 



\dujJ' 



Proof. We have 



then 



(34) 



H{x, y) = Tr{A{x, y))H{s{x, y))vr(^(x, y) 



9uj 



duj 



+ {no A){H o s] 



d{TToA 

duj 



Moreover 



d{Hos) _ rdH ^ \ ds 
dui \ dr J dui 



We also note that A[r, 0) = I and that at (r, 0) we have 



'^^ — 6 ■ 



0(7ro A) _^/dA\ d{ 



du 



\dujJ 



-vr 



V duj J 



Now replacing in (34) the first statement follows. 

To compute the second order derivative we start observing that at (r, 0) 
we have 

d'^{Hos) _d'^H ds ds ^dH d'^s _ ^ ^ .^^^ ^ .(^ 5 )^^ 
duiduj dr"^ dui duj dr duiduj dr"^ r ^'^ dr 

Now we differentiate the expression given in (^4|) with respect to Ui and 
evaluate it at (r, 0) S C^. 



duiduj 



duiduj 



i/(r) + 5.vrf^)^-.( — )F(r).(-) 



\duj/ dr 



dA\dH , ^ d^H 1 



, .{dA\dH , , 

+ '^li^ + 
\oujJ dr 



^ , , dH 

r dr 



dH .(^A^ .(^A^~ ^A^ 
^ dH .(dA\ ~. .d^{noA-^) 



dr \ duj J 



duiduj 



Now rearranging the right hand side of the above expression the proof is 
finished. □ 
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^2 



Proposition 13.3. At (r, 0) G C we have 
(35) 



d^TToA) _ . / d'^A \ _ ^ . fdAdA_\ _ ^ . / dA dA \ 
duiduj \duiduj) ^ \duidujJ ^ \duj duiJ 



^ \duj/ \dui/ ^ \dui/ \duj) 



and 



(36) 



dujdui \dujdui/ ^ \duidun/ ^ \dun duj 



\duj) \dui/ ^ \dui) \duj) 



Proof. For |x| and |y| sufficiently small we consider 

(37) X(x, y) = \og{A{x, y)) = B{x, y) - + - • • • 

where B{x,y) = A{x,y) — I. Then 

HX{x,y)y 



'n-{A{x,y)) = 7r(exp X{x,y)) = exp 7r{X{x,y)) = ^ 



Now we differentiate with respect to Uj to obtain 

d{7roA) .(dX\ i./dX\..^. i.,^,./dX\ 

(38) 



Since X{r,0) = 0, if we differentiate ( pq ) and evaluate at (r, 0) we obtain 

52(7ro^) _ / a^X \ ^/dX\./dX\ ^/dX\/dX\ 
duiduj \duiduj/ ^ \duj/ \dui/ ^ \dui) \duj/ 

,2 - 



To compute — — and — — - — we differentiate (37) and we get 

OUj OUiOUj 

OUj OUj V OUj ) V OUj ) V OUj ) 

+ \b(—\b^ ^bH—) + • • • . 

^ \duj/ ^ \duj/ 
Since -B(?', 0) = we have 



dX ^ ^ dB , ^ dA , ^ 
_(,.0) = — (r,0) = ^(r,0). 
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We also have at (r, 0) G 

duiduj duiduj ^ duj dui ^ dui duj 
Replacing in (39) the first statement in the lemma follows. 

dHnoA-^) , 
JNow we compute — - — . We observe that 

OUiOUj 

Therefore at (r, 0) G we have, 

d'^in o A-^) _ d{TT o A-^) o A) d'^in o A) o A) d{i: o A-^) 

duiduj dui duj duiduj duj dui 

Then the statement in (^) follows from p5| ) and 

di-KoA) _^rdA\ d{T: o A'^) _ ^fdA\ 



duj V duj 7 ' duj V duj 7 



□ 



Now we specialize the above propositions in the different cases we need. 
Lemma |5.4| . At (r, 0) G w;e have 

Hy,ir,0) = -^(^n{J)Hir)-Hir)niJ) 
and 

Hy.y. ('^^) = l^ + ^ {^^Jf ^{r) + H{r) i.{jf) - ^,^J)H{r) ^( J), 
where J = (^^il,^- 

Proof. To compute dA / du^ at (r, yi ) G we consider 
Therefore 

— (r,0) = J and — ^(r,0) = ^I. 

By Proposition 13.3| we have at (r, 0) G 



Now from Proposition |13.2| we obtain 

— (r,0) = --(7^(J)^(r)-#(rH(J)), 
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(r,0) = -i:{jfH{r) + -HirWf + --^ M)H[r)'k{J). 



dyf 

This completes the proof of the lemma. 
Lemma 5.5. At (r, 0) G we have 



r dr 



□ 



Hy,{r,Q) = -[i:{T)H{r)-H{r)i,[T) 



and 



where T= (°^). 

Proof. In this case we take A(x, y) 



r iy2 



Therefore 



dA , ^ i , 1 

— r,0 and -^r,0 =--/. 



By Proposition 13.3| we have at (r, 0) G 



92(7ro^) a2(7roA-i) 1 



Now from Proposition 13. 2| we get 

|^(r,0) = ^(^(r)i7(r)-i?(rH(r)), 



9y2 



.(r,0) = --^(r)^i/(r) - -R(r)T,{Ty + — ^ + ^^(r)i7(r)7^(r). 



r dr r^ 



The proof of the lemma is finished. 
Lemma 5.6. At (r, 0) G we have 



□ 



and 



^X2(r,0) = - [ii{H^)H{r)-H{r)ii{H^ 
r * 



+ \ii{H^)H{r)i,{H^ 
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Proof. In this case we have x = r + 1x2, y = 0, and 

1 1 r + ix 



Therefore 



A(x,y) = , , „ 

+ y2 Y r - IX 



-— (r,0) = - \ = -Ha and -^{r,0) = kI. 

0U2 r \() —I J r oui 



By Proposition 13.3| we have at (r, 0) G C 



2 



d^ino A) _ d^{-Ko A-^) _ 1 



Now from Proposition 13. 2| we have 



\2 



r 



dH , ^ i 
(r 



0) = ^ {7r{Ha)H{r) - H{r)iT{H^)) 



dx2 r 

fl2 IT 1 1 1 r7Pf 

- ^'k{Ha)H{r)iT{Ha). 
This completes the proof of the lemma. □ 
Lemma |5.7|. (r, 0) € w;e have 



H..n (r, 0) = ^ (-(•^)^ - ^^(J)) + V2 ( - HirW) 



Proof. It follows from Lemmas and |5.5| by differentiating with respect 
to r. □ 



Lemma |5.8| . At (r, 0) G «;e /laue 

- l^H{r) (jriHa) n{J) + n{J) n{Ha] 
+ ^ (n{Ha) H{r) n{J) + n{J) H{r) n{Ha 

Proof. In this case we have x = r + ix2 , y = yi, and 

1 (r + ix —yi 



A{x,y) 



j^y2 \ yi 



r — IX 
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Therefore 

dA , , i OA , , 1 d'^A , , 

— {r,0) = -H^, {r,0)=--J, r, = 0. 

OU2 r 0U3 r OU3OU2 

By Proposition |13.3| we have at (r, 0) G 

^ - - --^U{HMJ)+<J)^{Ha) 



du^du2 du3du2 2r^ 

Now the lemma follows from Proposition |13.2| . □ 

Lemma 5^. At (r, 0) G we have 

Hy,., (r, 0) = - ^ {f^iH^) KT) + HT) ^{H^)) H{r) 



+ ^ {ii{H^) H{r) n{T) + ir{T) H{r) ii{H^\ 



Proof. In this case we have x = r + 1x2, y = y2, and 

A(x v) = ^ f + 

+ x2 + 2/2 \ y2 r- ix 

Therefore 

dA ^ ^ « dA , , d'^A ^ ^ 

— (r, 0) = -H^, — (r, 0) = -T, ^^{r, 0) = 0. 

0U2 r 0U4 r ouiOU2 

By Proposition p.3.3| we have at (r, 0) G C2 

OU4OU2 0Ui0U2 
Now the lemma follows from Proposition |13.2| . □ 
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